2025-11-27T00:42:00,445 Created temporary directory: /tmp/pip-ephem-wheel-cache-6i6b0gl3 2025-11-27T00:42:00,447 Created temporary directory: /tmp/pip-build-tracker-i0t12tb4 2025-11-27T00:42:00,448 Initialized build tracking at /tmp/pip-build-tracker-i0t12tb4 2025-11-27T00:42:00,448 Created build tracker: /tmp/pip-build-tracker-i0t12tb4 2025-11-27T00:42:00,449 Entered build tracker: /tmp/pip-build-tracker-i0t12tb4 2025-11-27T00:42:00,450 Created temporary directory: /tmp/pip-wheel-tp3r0x1r 2025-11-27T00:42:00,453 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-27T00:42:00,455 Created temporary directory: /tmp/pip-ephem-wheel-cache-z8vd2ope 2025-11-27T00:42:00,477 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-27T00:42:00,481 2 location(s) to search for versions of lm-eval: 2025-11-27T00:42:00,481 * https://pypi.org/simple/lm-eval/ 2025-11-27T00:42:00,481 * https://www.piwheels.org/simple/lm-eval/ 2025-11-27T00:42:00,481 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2025-11-27T00:42:00,482 Getting page https://pypi.org/simple/lm-eval/ 2025-11-27T00:42:00,484 Found index url https://pypi.org/simple 2025-11-27T00:42:00,698 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json 2025-11-27T00:42:00,704 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,705 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2025-11-27T00:42:00,706 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,707 Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0 2025-11-27T00:42:00,708 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,709 Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0 2025-11-27T00:42:00,710 Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0 2025-11-27T00:42:00,711 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,712 Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1 2025-11-27T00:42:00,713 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,714 Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2 2025-11-27T00:42:00,715 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,716 Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3 2025-11-27T00:42:00,716 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,717 Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4 2025-11-27T00:42:00,718 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,719 Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5 2025-11-27T00:42:00,719 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,720 Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7 2025-11-27T00:42:00,721 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c3/0b/36d6117f644f3685e6b87005ecd7051d01e9cdcf617e8e671102c1546de2/lm_eval-0.4.8-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,722 Found link https://files.pythonhosted.org/packages/ba/b2/fe23d318c5f645636f9f776c373d1ba68aa55c998894660613a09b0fe2ec/lm_eval-0.4.8.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.8 2025-11-27T00:42:00,723 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/b6/4f/3ab58de3dfee26f693d149824d9d62723f771392c4756becccbcbaaa4e03/lm_eval-0.4.9-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,724 Found link https://files.pythonhosted.org/packages/e5/ab/866d8957cddbb26510e5cf5f7c5ec01e179f82d54d2dafd3a6c5c31fc200/lm_eval-0.4.9.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9 2025-11-27T00:42:00,724 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/18/ba/3a992d435deaf5461f50417bd7ba38a21831a04520941a9ecf1020dcf900/lm_eval-0.4.9.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,725 Found link https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9.1 2025-11-27T00:42:00,726 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/6c/50/3903694e69c94ae8dcec654843cb99799e45137e0d1a0a581009aa592673/lm_eval-0.4.9.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2025-11-27T00:42:00,727 Found link https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.9.2 2025-11-27T00:42:00,728 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2025-11-27T00:42:00,728 Getting page https://www.piwheels.org/simple/lm-eval/ 2025-11-27T00:42:00,729 Found index url https://www.piwheels.org/simple 2025-11-27T00:42:00,885 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html 2025-11-27T00:42:00,890 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.1-py3-none-any.whl#sha256=97ecff896cf8c8a3461730701532cb297638f594631d30e0a0e64bedacc771ce (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,891 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9-py3-none-any.whl#sha256=aae7521fd8819d6dd3ae674c07816f449a70669bef1db6cdce2968c21ad1f7af (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,891 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.8-py3-none-any.whl#sha256=1ed005366d8f0154fa200db6e0eb56cc5ef33df2bbd2705d19c742e4283593c8 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2025-11-27T00:42:00,892 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.7-py3-none-any.whl#sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,892 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,893 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,894 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,894 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,895 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,896 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2025-11-27T00:42:00,896 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,897 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,897 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2025-11-27T00:42:00,898 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2025-11-27T00:42:00,899 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2025-11-27T00:42:00,919 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2025-11-27T00:42:00,936 Collecting lm-eval==0.4.9.2 2025-11-27T00:42:00,939 Created temporary directory: /tmp/pip-unpack-cxwjfzus 2025-11-27T00:42:01,156 Downloading lm_eval-0.4.9.2.tar.gz (3.1 MB) 2025-11-27T00:42:22,608 Added lm-eval==0.4.9.2 from https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz to build tracker '/tmp/pip-build-tracker-i0t12tb4' 2025-11-27T00:42:22,615 Created temporary directory: /tmp/pip-build-env-0q_9rtlj 2025-11-27T00:42:22,620 Installing build dependencies: started 2025-11-27T00:42:22,621 Running command pip subprocess to install build dependencies 2025-11-27T00:42:23,757 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-11-27T00:42:24,352 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-27T00:42:24,375 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-27T00:42:26,135 Collecting setuptools>=40.8.0 2025-11-27T00:42:26,258 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-11-27T00:42:26,539 Collecting wheel 2025-11-27T00:42:26,555 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-11-27T00:42:29,470 Installing collected packages: wheel, setuptools 2025-11-27T00:42:29,714 Creating /tmp/pip-build-env-0q_9rtlj/overlay/local/bin 2025-11-27T00:42:29,716 changing mode of /tmp/pip-build-env-0q_9rtlj/overlay/local/bin/wheel to 755 2025-11-27T00:42:33,458 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-11-27T00:42:33,730 Installing build dependencies: finished with status 'done' 2025-11-27T00:42:33,736 Getting requirements to build wheel: started 2025-11-27T00:42:33,738 Running command Getting requirements to build wheel 2025-11-27T00:42:34,960 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-27T00:42:34,961 !! 2025-11-27T00:42:34,962 ******************************************************************************** 2025-11-27T00:42:34,962 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-27T00:42:34,964 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-27T00:42:34,964 or your builds will no longer be supported. 2025-11-27T00:42:34,965 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:34,966 ******************************************************************************** 2025-11-27T00:42:34,967 !! 2025-11-27T00:42:34,968 corresp(dist, value, root_dir) 2025-11-27T00:42:35,061 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:35,061 !! 2025-11-27T00:42:35,062 ******************************************************************************** 2025-11-27T00:42:35,063 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:35,064 License :: OSI Approved :: MIT License 2025-11-27T00:42:35,064 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:35,065 ******************************************************************************** 2025-11-27T00:42:35,066 !! 2025-11-27T00:42:35,066 dist._finalize_license_expression() 2025-11-27T00:42:35,067 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:35,067 !! 2025-11-27T00:42:35,068 ******************************************************************************** 2025-11-27T00:42:35,069 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:35,070 License :: OSI Approved :: MIT License 2025-11-27T00:42:35,071 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:35,071 ******************************************************************************** 2025-11-27T00:42:35,072 !! 2025-11-27T00:42:35,073 self._finalize_license_expression() 2025-11-27T00:42:35,073 running egg_info 2025-11-27T00:42:35,079 writing lm_eval.egg-info/PKG-INFO 2025-11-27T00:42:35,111 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2025-11-27T00:42:35,113 writing entry points to lm_eval.egg-info/entry_points.txt 2025-11-27T00:42:35,131 writing requirements to lm_eval.egg-info/requires.txt 2025-11-27T00:42:35,133 writing top-level names to lm_eval.egg-info/top_level.txt 2025-11-27T00:42:38,226 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:38,929 reading manifest template 'MANIFEST.in' 2025-11-27T00:42:38,929 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2025-11-27T00:42:38,931 adding license file 'LICENSE.md' 2025-11-27T00:42:39,690 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:39,815 Getting requirements to build wheel: finished with status 'done' 2025-11-27T00:42:39,819 Created temporary directory: /tmp/pip-modern-metadata-k75bv5bd 2025-11-27T00:42:39,822 Preparing metadata (pyproject.toml): started 2025-11-27T00:42:39,823 Running command Preparing metadata (pyproject.toml) 2025-11-27T00:42:40,668 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-27T00:42:40,668 !! 2025-11-27T00:42:40,669 ******************************************************************************** 2025-11-27T00:42:40,670 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-27T00:42:40,671 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-27T00:42:40,671 or your builds will no longer be supported. 2025-11-27T00:42:40,672 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:40,673 ******************************************************************************** 2025-11-27T00:42:40,674 !! 2025-11-27T00:42:40,675 corresp(dist, value, root_dir) 2025-11-27T00:42:40,775 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:40,775 !! 2025-11-27T00:42:40,776 ******************************************************************************** 2025-11-27T00:42:40,777 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:40,778 License :: OSI Approved :: MIT License 2025-11-27T00:42:40,779 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:40,779 ******************************************************************************** 2025-11-27T00:42:40,780 !! 2025-11-27T00:42:40,780 dist._finalize_license_expression() 2025-11-27T00:42:40,781 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:40,782 !! 2025-11-27T00:42:40,783 ******************************************************************************** 2025-11-27T00:42:40,783 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:40,784 License :: OSI Approved :: MIT License 2025-11-27T00:42:40,785 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:40,785 ******************************************************************************** 2025-11-27T00:42:40,786 !! 2025-11-27T00:42:40,787 self._finalize_license_expression() 2025-11-27T00:42:40,788 running dist_info 2025-11-27T00:42:40,800 creating /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info 2025-11-27T00:42:40,801 writing /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/PKG-INFO 2025-11-27T00:42:40,833 writing dependency_links to /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/dependency_links.txt 2025-11-27T00:42:40,835 writing entry points to /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/entry_points.txt 2025-11-27T00:42:40,852 writing requirements to /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/requires.txt 2025-11-27T00:42:40,853 writing top-level names to /tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/top_level.txt 2025-11-27T00:42:40,855 writing manifest file '/tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:45,861 reading manifest file '/tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:45,863 reading manifest template 'MANIFEST.in' 2025-11-27T00:42:45,864 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2025-11-27T00:42:45,865 adding license file 'LICENSE.md' 2025-11-27T00:42:46,342 writing manifest file '/tmp/pip-modern-metadata-k75bv5bd/lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:46,364 creating '/tmp/pip-modern-metadata-k75bv5bd/lm_eval-0.4.9.2.dist-info' 2025-11-27T00:42:46,509 Preparing metadata (pyproject.toml): finished with status 'done' 2025-11-27T00:42:46,517 Source in /tmp/pip-wheel-tp3r0x1r/lm-eval_49620b0b7e67443ea3a02ab5437e7963 has version 0.4.9.2, which satisfies requirement lm-eval==0.4.9.2 from https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz 2025-11-27T00:42:46,518 Removed lm-eval==0.4.9.2 from https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz from build tracker '/tmp/pip-build-tracker-i0t12tb4' 2025-11-27T00:42:46,531 Created temporary directory: /tmp/pip-unpack-f3_1n32k 2025-11-27T00:42:46,532 Building wheels for collected packages: lm-eval 2025-11-27T00:42:46,536 Created temporary directory: /tmp/pip-wheel-_js5usf1 2025-11-27T00:42:46,536 Destination directory: /tmp/pip-wheel-_js5usf1 2025-11-27T00:42:46,539 Building wheel for lm-eval (pyproject.toml): started 2025-11-27T00:42:46,541 Running command Building wheel for lm-eval (pyproject.toml) 2025-11-27T00:42:47,370 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-27T00:42:47,370 !! 2025-11-27T00:42:47,371 ******************************************************************************** 2025-11-27T00:42:47,372 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-27T00:42:47,373 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-27T00:42:47,373 or your builds will no longer be supported. 2025-11-27T00:42:47,374 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:47,375 ******************************************************************************** 2025-11-27T00:42:47,375 !! 2025-11-27T00:42:47,376 corresp(dist, value, root_dir) 2025-11-27T00:42:47,466 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:47,467 !! 2025-11-27T00:42:47,468 ******************************************************************************** 2025-11-27T00:42:47,469 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:47,470 License :: OSI Approved :: MIT License 2025-11-27T00:42:47,471 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:47,471 ******************************************************************************** 2025-11-27T00:42:47,472 !! 2025-11-27T00:42:47,473 dist._finalize_license_expression() 2025-11-27T00:42:47,474 /tmp/pip-build-env-0q_9rtlj/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-27T00:42:47,474 !! 2025-11-27T00:42:47,475 ******************************************************************************** 2025-11-27T00:42:47,476 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-27T00:42:47,477 License :: OSI Approved :: MIT License 2025-11-27T00:42:47,478 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-27T00:42:47,479 ******************************************************************************** 2025-11-27T00:42:47,480 !! 2025-11-27T00:42:47,481 self._finalize_license_expression() 2025-11-27T00:42:47,481 running bdist_wheel 2025-11-27T00:42:47,497 running build 2025-11-27T00:42:47,498 running build_py 2025-11-27T00:42:47,504 creating build/lib/lm_eval 2025-11-27T00:42:47,507 copying lm_eval/evaluator.py -> build/lib/lm_eval 2025-11-27T00:42:47,510 copying lm_eval/__init__.py -> build/lib/lm_eval 2025-11-27T00:42:47,511 copying lm_eval/utils.py -> build/lib/lm_eval 2025-11-27T00:42:47,514 copying lm_eval/evaluator_utils.py -> build/lib/lm_eval 2025-11-27T00:42:47,517 copying lm_eval/__main__.py -> build/lib/lm_eval 2025-11-27T00:42:47,521 creating build/lib/lm_eval/models 2025-11-27T00:42:47,522 copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,524 copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,527 copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,530 copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,532 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,534 copying lm_eval/models/gguf.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,537 copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,539 copying lm_eval/models/api_models.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,542 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,544 copying lm_eval/models/utils.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,547 copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,550 copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,552 copying lm_eval/models/sglang_generate_API.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,554 copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,558 copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,560 copying lm_eval/models/sglang_causallms.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,563 copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,566 copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,568 copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,571 copying lm_eval/models/hf_steered.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,573 copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,576 copying lm_eval/models/hf_audiolm.py -> build/lib/lm_eval/models 2025-11-27T00:42:47,579 creating build/lib/lm_eval/api 2025-11-27T00:42:47,580 copying lm_eval/api/filter.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,582 copying lm_eval/api/registry.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,585 copying lm_eval/api/__init__.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,586 copying lm_eval/api/samplers.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,589 copying lm_eval/api/model.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,591 copying lm_eval/api/metrics.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,594 copying lm_eval/api/instance.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,596 copying lm_eval/api/task.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,599 copying lm_eval/api/group.py -> build/lib/lm_eval/api 2025-11-27T00:42:47,602 creating build/lib/lm_eval/prompts 2025-11-27T00:42:47,603 copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts 2025-11-27T00:42:47,605 creating build/lib/lm_eval/caching 2025-11-27T00:42:47,607 copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching 2025-11-27T00:42:47,608 copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching 2025-11-27T00:42:47,611 creating build/lib/lm_eval/loggers 2025-11-27T00:42:47,612 copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers 2025-11-27T00:42:47,614 copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers 2025-11-27T00:42:47,616 copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers 2025-11-27T00:42:47,619 copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers 2025-11-27T00:42:47,622 creating build/lib/lm_eval/filters 2025-11-27T00:42:47,623 copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,625 copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,627 copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,629 copying lm_eval/filters/custom.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,631 copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,633 copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters 2025-11-27T00:42:47,636 creating build/lib/lm_eval/tasks 2025-11-27T00:42:47,637 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2025-11-27T00:42:47,640 creating build/lib/lm_eval/decontamination 2025-11-27T00:42:47,641 copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination 2025-11-27T00:42:47,644 copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination 2025-11-27T00:42:47,645 copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination 2025-11-27T00:42:47,648 copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination 2025-11-27T00:42:47,651 creating build/lib/lm_eval/tasks/winogrande 2025-11-27T00:42:47,652 copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande 2025-11-27T00:42:47,655 creating build/lib/lm_eval/tasks/pubmedqa 2025-11-27T00:42:47,656 copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa 2025-11-27T00:42:47,659 creating build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:47,660 copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:47,662 copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:47,664 creating build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:47,665 copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:47,668 creating build/lib/lm_eval/tasks/medqa 2025-11-27T00:42:47,669 copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa 2025-11-27T00:42:47,672 creating build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:47,673 copying lm_eval/tasks/arab_culture/utils_mcq.py -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:47,675 copying lm_eval/tasks/arab_culture/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:47,677 copying lm_eval/tasks/arab_culture/prompts.py -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:47,680 creating build/lib/lm_eval/tasks/afrixnli 2025-11-27T00:42:47,681 copying lm_eval/tasks/afrixnli/gen_utils.py -> build/lib/lm_eval/tasks/afrixnli 2025-11-27T00:42:47,683 copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli 2025-11-27T00:42:47,686 creating build/lib/lm_eval/tasks/paws-x 2025-11-27T00:42:47,687 copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:42:47,690 copying lm_eval/tasks/paws-x/utils.py -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:42:47,692 creating build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:42:47,693 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:42:47,695 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:42:47,697 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:42:47,699 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:42:47,702 creating build/lib/lm_eval/tasks/careqa 2025-11-27T00:42:47,703 copying lm_eval/tasks/careqa/utils_perplexity.py -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:42:47,706 copying lm_eval/tasks/careqa/utils.py -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:42:47,708 copying lm_eval/tasks/careqa/utils_open.py -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:42:47,712 creating build/lib/lm_eval/tasks/mbpp 2025-11-27T00:42:47,713 copying lm_eval/tasks/mbpp/utils.py -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:42:47,716 creating build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:42:47,717 copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:42:47,720 creating build/lib/lm_eval/tasks/realtoxicityprompts 2025-11-27T00:42:47,721 copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts 2025-11-27T00:42:47,724 creating build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:42:47,725 copying lm_eval/tasks/jsonschema_bench/metrics.py -> build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:42:47,728 creating build/lib/lm_eval/tasks/longbench 2025-11-27T00:42:47,729 copying lm_eval/tasks/longbench/_generate_config.py -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:42:47,732 copying lm_eval/tasks/longbench/utils.py -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:42:47,734 copying lm_eval/tasks/longbench/metrics.py -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:42:47,736 creating build/lib/lm_eval/tasks/eus_trivia 2025-11-27T00:42:47,737 copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia 2025-11-27T00:42:47,740 creating build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:42:47,741 copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:42:47,743 copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:42:47,746 creating build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:42:47,747 copying lm_eval/tasks/graphwalks/utils.py -> build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:42:47,750 creating build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:42:47,751 copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:42:47,754 creating build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:42:47,755 copying lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:42:47,757 copying lm_eval/tasks/mimic_repsum/utils.py -> build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:42:47,759 creating build/lib/lm_eval/tasks/mutual 2025-11-27T00:42:47,760 copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual 2025-11-27T00:42:47,763 creating build/lib/lm_eval/tasks/translation 2025-11-27T00:42:47,764 copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation 2025-11-27T00:42:47,768 creating build/lib/lm_eval/tasks/belebele 2025-11-27T00:42:47,769 copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:42:47,771 creating build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:42:47,772 copying lm_eval/tasks/afrimgsm/gen_utils.py -> build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:42:47,775 copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:42:47,777 creating build/lib/lm_eval/tasks/hellaswag 2025-11-27T00:42:47,778 copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag 2025-11-27T00:42:47,781 creating build/lib/lm_eval/tasks/unitxt 2025-11-27T00:42:47,782 copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:42:47,785 creating build/lib/lm_eval/tasks/med_text_classification 2025-11-27T00:42:47,787 copying lm_eval/tasks/med_text_classification/utils.py -> build/lib/lm_eval/tasks/med_text_classification 2025-11-27T00:42:47,789 creating build/lib/lm_eval/tasks/medmcqa 2025-11-27T00:42:47,790 copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa 2025-11-27T00:42:47,793 creating build/lib/lm_eval/tasks/groundcocoa 2025-11-27T00:42:47,794 copying lm_eval/tasks/groundcocoa/utils.py -> build/lib/lm_eval/tasks/groundcocoa 2025-11-27T00:42:47,797 creating build/lib/lm_eval/tasks/lingoly 2025-11-27T00:42:47,798 copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:42:47,801 copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:42:47,803 creating build/lib/lm_eval/tasks/c4 2025-11-27T00:42:47,805 copying lm_eval/tasks/c4/preprocess_c4.py -> build/lib/lm_eval/tasks/c4 2025-11-27T00:42:47,807 creating build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:42:47,809 copying lm_eval/tasks/humaneval_infilling/utils.py -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:42:47,812 creating build/lib/lm_eval/tasks/drop 2025-11-27T00:42:47,813 copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop 2025-11-27T00:42:47,816 creating build/lib/lm_eval/tasks/discrim_eval 2025-11-27T00:42:47,818 copying lm_eval/tasks/discrim_eval/utils.py -> build/lib/lm_eval/tasks/discrim_eval 2025-11-27T00:42:47,820 creating build/lib/lm_eval/tasks/fda 2025-11-27T00:42:47,821 copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda 2025-11-27T00:42:47,824 creating build/lib/lm_eval/tasks/bbh 2025-11-27T00:42:47,825 copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh 2025-11-27T00:42:47,827 creating build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:42:47,828 copying lm_eval/tasks/egymmlu/utils.py -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:42:47,831 copying lm_eval/tasks/egymmlu/_generate_configs.py -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:42:47,833 creating build/lib/lm_eval/tasks/mmlu_prox 2025-11-27T00:42:47,834 copying lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2025-11-27T00:42:47,836 copying lm_eval/tasks/mmlu_prox/lang_libs.py -> build/lib/lm_eval/tasks/mmlu_prox 2025-11-27T00:42:47,839 copying lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2025-11-27T00:42:47,843 creating build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,844 copying lm_eval/tasks/ruler/niah_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,846 copying lm_eval/tasks/ruler/common_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,848 copying lm_eval/tasks/ruler/essays.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,850 copying lm_eval/tasks/ruler/fwe_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,853 copying lm_eval/tasks/ruler/cwe_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,855 copying lm_eval/tasks/ruler/qa_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,857 copying lm_eval/tasks/ruler/vt_utils.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,860 copying lm_eval/tasks/ruler/prepare_niah.py -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:42:47,863 creating build/lib/lm_eval/tasks/cnn_dailymail 2025-11-27T00:42:47,864 copying lm_eval/tasks/cnn_dailymail/utils.py -> build/lib/lm_eval/tasks/cnn_dailymail 2025-11-27T00:42:47,867 creating build/lib/lm_eval/tasks/winogender 2025-11-27T00:42:47,868 copying lm_eval/tasks/winogender/utils.py -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:42:47,871 creating build/lib/lm_eval/tasks/olaph 2025-11-27T00:42:47,872 copying lm_eval/tasks/olaph/utils_perplexity.py -> build/lib/lm_eval/tasks/olaph 2025-11-27T00:42:47,874 copying lm_eval/tasks/olaph/utils.py -> build/lib/lm_eval/tasks/olaph 2025-11-27T00:42:47,877 creating build/lib/lm_eval/tasks/score 2025-11-27T00:42:47,878 copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score 2025-11-27T00:42:47,881 copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score 2025-11-27T00:42:47,884 creating build/lib/lm_eval/tasks/ifeval 2025-11-27T00:42:47,885 copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:42:47,888 copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:42:47,891 copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:42:47,893 copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:42:47,897 creating build/lib/lm_eval/tasks/squad_completion 2025-11-27T00:42:47,898 copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion 2025-11-27T00:42:47,901 creating build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:42:47,902 copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:42:47,905 creating build/lib/lm_eval/tasks/aclue 2025-11-27T00:42:47,906 copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:42:47,909 creating build/lib/lm_eval/tasks/wikitext 2025-11-27T00:42:47,911 copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext 2025-11-27T00:42:47,914 creating build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:42:47,915 copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:42:47,918 creating build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:42:47,919 copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:42:47,922 creating build/lib/lm_eval/tasks/toxigen 2025-11-27T00:42:47,923 copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen 2025-11-27T00:42:47,926 creating build/lib/lm_eval/tasks/squadv2 2025-11-27T00:42:47,927 copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2 2025-11-27T00:42:47,930 creating build/lib/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:42:47,931 copying lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:42:47,933 creating build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:42:47,934 copying lm_eval/tasks/darijammlu/utils.py -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:42:47,937 copying lm_eval/tasks/darijammlu/_generate_configs.py -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:42:47,939 creating build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:42:47,940 copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:42:47,942 copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:42:47,944 copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:42:47,946 copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:42:47,949 creating build/lib/lm_eval/tasks/mgsm 2025-11-27T00:42:47,950 copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm 2025-11-27T00:42:47,955 creating build/lib/lm_eval/tasks/copal_id 2025-11-27T00:42:47,956 copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id 2025-11-27T00:42:47,958 creating build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:42:47,959 copying lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:42:47,961 copying lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:42:47,963 copying lm_eval/tasks/arab_culture_completion/prompts.py -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:42:47,966 creating build/lib/lm_eval/tasks/xnli 2025-11-27T00:42:47,967 copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:42:47,970 creating build/lib/lm_eval/tasks/medtext 2025-11-27T00:42:47,971 copying lm_eval/tasks/medtext/utils_perplexity.py -> build/lib/lm_eval/tasks/medtext 2025-11-27T00:42:47,973 copying lm_eval/tasks/medtext/utils.py -> build/lib/lm_eval/tasks/medtext 2025-11-27T00:42:47,976 creating build/lib/lm_eval/tasks/eus_reading 2025-11-27T00:42:47,977 copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading 2025-11-27T00:42:47,980 creating build/lib/lm_eval/tasks/esbbq 2025-11-27T00:42:47,981 copying lm_eval/tasks/esbbq/utils.py -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:42:47,985 creating build/lib/lm_eval/tasks/paloma 2025-11-27T00:42:47,986 copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:42:47,989 creating build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:42:47,990 copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:42:47,993 creating build/lib/lm_eval/tasks/afrimmlu 2025-11-27T00:42:47,994 copying lm_eval/tasks/afrimmlu/gen_utils.py -> build/lib/lm_eval/tasks/afrimmlu 2025-11-27T00:42:47,996 copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu 2025-11-27T00:42:47,998 creating build/lib/lm_eval/tasks/med_prescriptions 2025-11-27T00:42:47,999 copying lm_eval/tasks/med_prescriptions/utils.py -> build/lib/lm_eval/tasks/med_prescriptions 2025-11-27T00:42:48,003 creating build/lib/lm_eval/tasks/icelandic_winogrande 2025-11-27T00:42:48,004 copying lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/icelandic_winogrande 2025-11-27T00:42:48,007 creating build/lib/lm_eval/tasks/wsc273 2025-11-27T00:42:48,008 copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273 2025-11-27T00:42:48,011 creating build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:42:48,012 copying lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:42:48,014 copying lm_eval/tasks/mts_dialog/utils.py -> build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:42:48,017 creating build/lib/lm_eval/tasks/aime 2025-11-27T00:42:48,018 copying lm_eval/tasks/aime/utils.py -> build/lib/lm_eval/tasks/aime 2025-11-27T00:42:48,021 creating build/lib/lm_eval/tasks/scrolls 2025-11-27T00:42:48,022 copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:42:48,026 creating build/lib/lm_eval/tasks/qasper 2025-11-27T00:42:48,027 copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper 2025-11-27T00:42:48,029 copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper 2025-11-27T00:42:48,031 creating build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:42:48,032 copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:42:48,035 creating build/lib/lm_eval/tasks/mmlusr 2025-11-27T00:42:48,036 copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr 2025-11-27T00:42:48,039 creating build/lib/lm_eval/tasks/mmlu 2025-11-27T00:42:48,040 copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu 2025-11-27T00:42:48,043 creating build/lib/lm_eval/tasks/wmt2016 2025-11-27T00:42:48,044 copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016 2025-11-27T00:42:48,047 creating build/lib/lm_eval/tasks/agieval 2025-11-27T00:42:48,048 copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:42:48,051 creating build/lib/lm_eval/tasks/humaneval 2025-11-27T00:42:48,052 copying lm_eval/tasks/humaneval/utils.py -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:42:48,055 creating build/lib/lm_eval/tasks/histoires_morales 2025-11-27T00:42:48,056 copying lm_eval/tasks/histoires_morales/utils.py -> build/lib/lm_eval/tasks/histoires_morales 2025-11-27T00:42:48,058 creating build/lib/lm_eval/tasks/cabbq 2025-11-27T00:42:48,060 copying lm_eval/tasks/cabbq/utils.py -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:42:48,063 creating build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:42:48,064 copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:42:48,066 creating build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:42:48,067 copying lm_eval/tasks/evalita_llm/sum_utils.py -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:42:48,069 copying lm_eval/tasks/evalita_llm/utils.py -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:42:48,072 copying lm_eval/tasks/evalita_llm/metrics.py -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:42:48,075 creating build/lib/lm_eval/tasks/logiqa2 2025-11-27T00:42:48,076 copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2 2025-11-27T00:42:48,078 creating build/lib/lm_eval/tasks/meddialog 2025-11-27T00:42:48,079 copying lm_eval/tasks/meddialog/utils_perplexity.py -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:42:48,081 copying lm_eval/tasks/meddialog/utils.py -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:42:48,085 creating build/lib/lm_eval/tasks/bigbench 2025-11-27T00:42:48,086 copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:42:48,089 copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:42:48,092 creating build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:42:48,094 copying lm_eval/tasks/mmlu-pro-plus/utils.py -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:42:48,096 creating build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:42:48,097 copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:42:48,100 creating build/lib/lm_eval/tasks/libra 2025-11-27T00:42:48,101 copying lm_eval/tasks/libra/utils.py -> build/lib/lm_eval/tasks/libra 2025-11-27T00:42:48,104 creating build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:42:48,105 copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:42:48,108 creating build/lib/lm_eval/tasks/webqs 2025-11-27T00:42:48,110 copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs 2025-11-27T00:42:48,113 creating build/lib/lm_eval/tasks/mmmu 2025-11-27T00:42:48,114 copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:42:48,118 creating build/lib/lm_eval/tasks/babilong 2025-11-27T00:42:48,119 copying lm_eval/tasks/babilong/common_utils.py -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:42:48,121 creating build/lib/lm_eval/tasks/blimp 2025-11-27T00:42:48,122 copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:42:48,125 creating build/lib/lm_eval/tasks/coqa 2025-11-27T00:42:48,126 copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa 2025-11-27T00:42:48,129 creating build/lib/lm_eval/tasks/ceval 2025-11-27T00:42:48,130 copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:42:48,133 creating build/lib/lm_eval/tasks/egyhellaswag 2025-11-27T00:42:48,134 copying lm_eval/tasks/egyhellaswag/utils.py -> build/lib/lm_eval/tasks/egyhellaswag 2025-11-27T00:42:48,137 creating build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:42:48,138 copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:42:48,141 creating build/lib/lm_eval/tasks/noticia 2025-11-27T00:42:48,143 copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia 2025-11-27T00:42:48,145 creating build/lib/lm_eval/tasks/logiqa 2025-11-27T00:42:48,146 copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa 2025-11-27T00:42:48,149 creating build/lib/lm_eval/tasks/common_voice 2025-11-27T00:42:48,150 copying lm_eval/tasks/common_voice/utils.py -> build/lib/lm_eval/tasks/common_voice 2025-11-27T00:42:48,153 creating build/lib/lm_eval/tasks/race 2025-11-27T00:42:48,154 copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race 2025-11-27T00:42:48,157 creating build/lib/lm_eval/tasks/darijahellaswag 2025-11-27T00:42:48,158 copying lm_eval/tasks/darijahellaswag/utils.py -> build/lib/lm_eval/tasks/darijahellaswag 2025-11-27T00:42:48,160 creating build/lib/lm_eval/tasks/mathqa 2025-11-27T00:42:48,161 copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa 2025-11-27T00:42:48,164 creating build/lib/lm_eval/tasks/xcopa 2025-11-27T00:42:48,165 copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:42:48,168 creating build/lib/lm_eval/tasks/xquad 2025-11-27T00:42:48,169 copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:42:48,172 creating build/lib/lm_eval/tasks/eq_bench 2025-11-27T00:42:48,173 copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench 2025-11-27T00:42:48,176 creating build/lib/lm_eval/tasks/csatqa 2025-11-27T00:42:48,177 copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:42:48,180 copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:42:48,183 creating build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:42:48,184 copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:42:48,187 creating build/lib/lm_eval/tasks/swde 2025-11-27T00:42:48,188 copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde 2025-11-27T00:42:48,191 creating build/lib/lm_eval/tasks/meqsum 2025-11-27T00:42:48,192 copying lm_eval/tasks/meqsum/utils.py -> build/lib/lm_eval/tasks/meqsum 2025-11-27T00:42:48,194 creating build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:42:48,195 copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:42:48,197 copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:42:48,200 creating build/lib/lm_eval/tasks/chartqa 2025-11-27T00:42:48,201 copying lm_eval/tasks/chartqa/utils.py -> build/lib/lm_eval/tasks/chartqa 2025-11-27T00:42:48,204 creating build/lib/lm_eval/tasks/moral_stories 2025-11-27T00:42:48,205 copying lm_eval/tasks/moral_stories/utils.py -> build/lib/lm_eval/tasks/moral_stories 2025-11-27T00:42:48,208 creating build/lib/lm_eval/tasks/kobest 2025-11-27T00:42:48,209 copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:42:48,212 creating build/lib/lm_eval/tasks/glianorex 2025-11-27T00:42:48,212 copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex 2025-11-27T00:42:48,215 creating build/lib/lm_eval/tasks/mlqa 2025-11-27T00:42:48,216 copying lm_eval/tasks/mlqa/generate_tasks.py -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:42:48,218 copying lm_eval/tasks/mlqa/utils.py -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:42:48,221 creating build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:42:48,222 copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:42:48,225 creating build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:42:48,226 copying lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:42:48,228 copying lm_eval/tasks/mediqa_qa2019/utils.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:42:48,231 creating build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:42:48,232 copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:42:48,235 creating build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:42:48,236 copying lm_eval/tasks/truthfulqa-multi/utils.py -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:42:48,240 creating build/lib/lm_eval/tasks/bbq 2025-11-27T00:42:48,241 copying lm_eval/tasks/bbq/utils.py -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:42:48,244 creating build/lib/lm_eval/tasks/metabench 2025-11-27T00:42:48,245 copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:42:48,247 copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:42:48,254 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:48,256 copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:48,258 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:48,259 copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:48,262 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:48,263 copying lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:48,266 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:48,267 copying lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:48,270 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:48,271 copying lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:48,273 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:48,274 copying lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:48,276 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:48,277 copying lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:48,280 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:48,282 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:48,284 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:48,285 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:48,287 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:48,289 copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:48,291 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:48,293 copying lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:48,295 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:48,296 copying lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:48,299 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:48,300 copying lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:48,302 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:48,303 copying lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:48,306 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:48,307 copying lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:48,310 creating build/lib/lm_eval/tasks/afrobench/naijarc 2025-11-27T00:42:48,312 copying lm_eval/tasks/afrobench/naijarc/utils.py -> build/lib/lm_eval/tasks/afrobench/naijarc 2025-11-27T00:42:48,314 creating build/lib/lm_eval/tasks/afrobench/ntrex 2025-11-27T00:42:48,315 copying lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/ntrex 2025-11-27T00:42:48,318 creating build/lib/lm_eval/tasks/afrobench/mafand 2025-11-27T00:42:48,319 copying lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/mafand 2025-11-27T00:42:48,322 creating build/lib/lm_eval/tasks/afrobench/belebele 2025-11-27T00:42:48,323 copying lm_eval/tasks/afrobench/belebele/utils.py -> build/lib/lm_eval/tasks/afrobench/belebele 2025-11-27T00:42:48,326 creating build/lib/lm_eval/tasks/afrobench/injongointent 2025-11-27T00:42:48,327 copying lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent 2025-11-27T00:42:48,330 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:42:48,331 copying lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:42:48,334 creating build/lib/lm_eval/tasks/afrobench/adr 2025-11-27T00:42:48,335 copying lm_eval/tasks/afrobench/adr/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/adr 2025-11-27T00:42:48,337 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:42:48,339 copying lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:42:48,341 creating build/lib/lm_eval/tasks/afrobench/salt 2025-11-27T00:42:48,342 copying lm_eval/tasks/afrobench/salt/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/salt 2025-11-27T00:42:48,345 creating build/lib/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:42:48,346 copying lm_eval/tasks/afrobench/afrisenti/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:42:48,349 creating build/lib/lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:42:48,350 copying lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:42:48,352 creating build/lib/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:42:48,353 copying lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:42:48,356 copying lm_eval/tasks/afrobench/masakhapos/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:42:48,358 creating build/lib/lm_eval/tasks/afrobench/flores 2025-11-27T00:42:48,359 copying lm_eval/tasks/afrobench/flores/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/flores 2025-11-27T00:42:48,362 creating build/lib/lm_eval/tasks/afrobench/afriqa 2025-11-27T00:42:48,363 copying lm_eval/tasks/afrobench/afriqa/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa 2025-11-27T00:42:48,366 creating build/lib/lm_eval/tasks/afrobench/xlsum 2025-11-27T00:42:48,367 copying lm_eval/tasks/afrobench/xlsum/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum 2025-11-27T00:42:48,370 creating build/lib/lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:42:48,371 copying lm_eval/tasks/afrobench/masakhanews/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:42:48,374 creating build/lib/lm_eval/tasks/afrobench/sib 2025-11-27T00:42:48,375 copying lm_eval/tasks/afrobench/sib/utils.py -> build/lib/lm_eval/tasks/afrobench/sib 2025-11-27T00:42:48,379 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:42:48,380 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:42:48,383 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:42:48,384 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:42:48,387 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:42:48,388 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:42:48,391 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:42:48,392 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:42:48,395 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:42:48,396 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:42:48,405 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:42:48,407 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:42:48,410 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:42:48,412 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:42:48,415 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:42:48,417 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:42:48,420 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:42:48,421 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:42:48,425 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:42:48,426 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:42:48,430 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:42:48,431 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:42:48,436 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:42:48,438 copying lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:42:48,440 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:42:48,441 copying lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:42:48,444 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:42:48,445 copying lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:42:48,448 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:42:48,449 copying lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:42:48,452 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:42:48,453 copying lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:42:48,459 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:42:48,461 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:42:48,463 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:42:48,465 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:42:48,467 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:42:48,469 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:42:48,471 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:42:48,473 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:42:48,475 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:42:48,476 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:42:48,480 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:42:48,481 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:42:48,484 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:42:48,486 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:42:48,488 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:42:48,490 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:42:48,492 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:42:48,494 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:42:48,496 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:42:48,499 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:42:48,500 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:42:48,502 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:42:48,504 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:42:48,506 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:42:48,508 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:42:48,510 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:42:48,512 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:42:48,515 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:42:48,516 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:42:48,519 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:42:48,520 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:42:48,523 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:42:48,524 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:42:48,527 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:42:48,529 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:42:48,532 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:42:48,533 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:42:48,536 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:42:48,537 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:42:48,540 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:42:48,541 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:42:48,544 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:42:48,545 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:42:48,548 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:42:48,549 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:42:48,556 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:42:48,557 copying lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:42:48,560 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:42:48,561 copying lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:42:48,564 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:42:48,566 copying lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:42:48,569 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:42:48,570 copying lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:42:48,573 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:42:48,574 copying lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:42:48,577 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:42:48,578 copying lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:42:48,581 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:42:48,582 copying lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:42:48,585 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:42:48,586 copying lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:42:48,589 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:42:48,590 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:42:48,593 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:42:48,594 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:42:48,597 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:42:48,598 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:42:48,601 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:42:48,602 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:42:48,605 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:42:48,606 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:42:48,609 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:42:48,610 copying lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:42:48,613 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:42:48,614 copying lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:42:48,617 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:42:48,618 copying lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:42:48,621 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:42:48,622 copying lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:42:48,625 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:42:48,626 copying lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:42:48,629 creating build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:42:48,632 copying lm_eval/tasks/include/default/Japanese/utils.py -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:42:48,634 creating build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:42:48,635 copying lm_eval/tasks/include/default/Telugu/utils.py -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:42:48,638 creating build/lib/lm_eval/tasks/include/default/Basque 2025-11-27T00:42:48,639 copying lm_eval/tasks/include/default/Basque/utils.py -> build/lib/lm_eval/tasks/include/default/Basque 2025-11-27T00:42:48,641 creating build/lib/lm_eval/tasks/include/default/Georgian 2025-11-27T00:42:48,642 copying lm_eval/tasks/include/default/Georgian/utils.py -> build/lib/lm_eval/tasks/include/default/Georgian 2025-11-27T00:42:48,645 creating build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:42:48,646 copying lm_eval/tasks/include/default/Italian/utils.py -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:42:48,648 creating build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:42:48,649 copying lm_eval/tasks/include/default/Chinese/utils.py -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:42:48,652 creating build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:42:48,653 copying lm_eval/tasks/include/default/Greek/utils.py -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:42:48,655 creating build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:42:48,656 copying lm_eval/tasks/include/default/Croatian/utils.py -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:42:48,658 creating build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:42:48,659 copying lm_eval/tasks/include/default/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:42:48,661 creating build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:42:48,662 copying lm_eval/tasks/include/default/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:42:48,665 creating build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:42:48,666 copying lm_eval/tasks/include/default/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:42:48,668 creating build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:42:48,669 copying lm_eval/tasks/include/default/Dutch/utils.py -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:42:48,671 creating build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:42:48,672 copying lm_eval/tasks/include/default/Serbian/utils.py -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:42:48,675 creating build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:42:48,676 copying lm_eval/tasks/include/default/Russian/utils.py -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:42:48,678 creating build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:42:48,679 copying lm_eval/tasks/include/default/Finnish/utils.py -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:42:48,682 creating build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:42:48,683 copying lm_eval/tasks/include/default/Hindi/utils.py -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:42:48,685 creating build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:42:48,686 copying lm_eval/tasks/include/default/Malay/utils.py -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:42:48,689 creating build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:42:48,690 copying lm_eval/tasks/include/default/Albanian/utils.py -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:42:48,692 creating build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:42:48,693 copying lm_eval/tasks/include/default/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:42:48,695 creating build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:42:48,696 copying lm_eval/tasks/include/default/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:42:48,699 creating build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:42:48,700 copying lm_eval/tasks/include/default/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:42:48,702 creating build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:42:48,703 copying lm_eval/tasks/include/default/Bengali/utils.py -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:42:48,706 creating build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:42:48,707 copying lm_eval/tasks/include/default/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:42:48,709 creating build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:42:48,710 copying lm_eval/tasks/include/default/Korean/utils.py -> build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:42:48,713 creating build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:42:48,714 copying lm_eval/tasks/include/default/Tamil/utils.py -> build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:42:48,717 creating build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:42:48,718 copying lm_eval/tasks/include/default/Urdu/utils.py -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:42:48,720 creating build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:42:48,721 copying lm_eval/tasks/include/default/Arabic/utils.py -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:42:48,724 creating build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:42:48,725 copying lm_eval/tasks/include/default/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:42:48,727 creating build/lib/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:42:48,728 copying lm_eval/tasks/include/default/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:42:48,730 creating build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:42:48,731 copying lm_eval/tasks/include/default/Armenian/utils.py -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:42:48,734 creating build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:42:48,735 copying lm_eval/tasks/include/default/Spanish/utils.py -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:42:48,737 creating build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:42:48,738 copying lm_eval/tasks/include/default/Estonian/utils.py -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:42:48,741 creating build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:42:48,742 copying lm_eval/tasks/include/default/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:42:48,744 creating build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:42:48,745 copying lm_eval/tasks/include/default/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:42:48,748 creating build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:42:48,749 copying lm_eval/tasks/include/default/Polish/utils.py -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:42:48,751 creating build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:42:48,752 copying lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:42:48,754 creating build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:42:48,755 copying lm_eval/tasks/include/default/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:42:48,758 creating build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:42:48,759 copying lm_eval/tasks/include/default/Turkish/utils.py -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:42:48,761 creating build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:42:48,762 copying lm_eval/tasks/include/default/German/utils.py -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:42:48,765 creating build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:42:48,766 copying lm_eval/tasks/include/default/Nepali/utils.py -> build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:42:48,768 creating build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:42:48,769 copying lm_eval/tasks/include/default/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:42:48,771 creating build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:42:48,773 copying lm_eval/tasks/include/default/French/utils.py -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:42:48,775 creating build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:42:48,776 copying lm_eval/tasks/include/default/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:42:48,779 creating build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:42:48,780 copying lm_eval/tasks/include/default/Persian/utils.py -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:42:48,783 creating build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:42:48,784 copying lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:42:48,787 creating build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:42:48,788 copying lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:42:48,790 creating build/lib/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:42:48,791 copying lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:42:48,793 creating build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:42:48,794 copying lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:42:48,796 creating build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:42:48,797 copying lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:42:48,800 creating build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:42:48,801 copying lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:42:48,803 creating build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:42:48,804 copying lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:42:48,807 creating build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:42:48,808 copying lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:42:48,810 creating build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:42:48,811 copying lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:42:48,815 creating build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:42:48,816 copying lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:42:48,819 creating build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:42:48,821 copying lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:42:48,826 creating build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:42:48,829 copying lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:42:48,831 creating build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:42:48,833 copying lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:42:48,835 creating build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:42:48,836 copying lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:42:48,838 creating build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:42:48,839 copying lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:42:48,842 creating build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:42:48,843 copying lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:42:48,845 creating build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:42:48,846 copying lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:42:48,849 creating build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:42:48,850 copying lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:42:48,853 creating build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:42:48,854 copying lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:42:48,857 creating build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:42:48,858 copying lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:42:48,860 creating build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:42:48,861 copying lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:42:48,864 creating build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:42:48,865 copying lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:42:48,867 creating build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:42:48,868 copying lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:42:48,871 creating build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:42:48,872 copying lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:42:48,874 creating build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:42:48,875 copying lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:42:48,878 creating build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:42:48,879 copying lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:42:48,881 creating build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:42:48,882 copying lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:42:48,884 creating build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:42:48,885 copying lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:42:48,888 creating build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:42:48,889 copying lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:42:48,891 creating build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:42:48,893 copying lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:42:48,895 creating build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:42:48,896 copying lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:42:48,899 creating build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:42:48,900 copying lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:42:48,902 creating build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:42:48,903 copying lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:42:48,906 creating build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:42:48,907 copying lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:42:48,910 creating build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:42:48,911 copying lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:42:48,913 creating build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:42:48,915 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:42:48,917 creating build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:42:48,918 copying lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:42:48,921 creating build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:42:48,922 copying lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:42:48,924 creating build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:42:48,925 copying lm_eval/tasks/include/few_shot_og/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:42:48,928 creating build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:42:48,929 copying lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:42:48,931 creating build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:42:48,932 copying lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:42:48,935 creating build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:42:48,936 copying lm_eval/tasks/include/few_shot_og/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:42:48,938 creating build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:42:48,939 copying lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:42:48,942 creating build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:42:48,943 copying lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:42:48,946 creating build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:42:48,947 copying lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:42:48,950 creating build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:42:48,951 copying lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:42:48,953 creating build/lib/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:42:48,955 copying lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:42:48,958 creating build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:42:48,959 copying lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:42:48,962 creating build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:42:48,964 copying lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:42:48,967 creating build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:42:48,968 copying lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:42:48,971 creating build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:42:48,973 copying lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:42:48,976 creating build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:42:48,977 copying lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:42:48,980 creating build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:42:48,981 copying lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:42:48,985 creating build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:42:48,986 copying lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:42:48,989 creating build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:42:48,991 copying lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:42:48,994 creating build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:42:48,995 copying lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:42:48,999 creating build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:42:49,000 copying lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:42:49,003 creating build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:42:49,004 copying lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:42:49,007 creating build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:42:49,008 copying lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:42:49,011 creating build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:42:49,013 copying lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:42:49,016 creating build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:42:49,017 copying lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:42:49,020 creating build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:42:49,022 copying lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:42:49,025 creating build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:42:49,026 copying lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:42:49,029 creating build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:42:49,031 copying lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:42:49,034 creating build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:42:49,035 copying lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:42:49,039 creating build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:42:49,040 copying lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:42:49,043 creating build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:42:49,044 copying lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:42:49,047 creating build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:42:49,048 copying lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:42:49,052 creating build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:42:49,053 copying lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:42:49,056 creating build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:42:49,057 copying lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:42:49,059 creating build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:42:49,060 copying lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:42:49,063 creating build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:42:49,064 copying lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:42:49,066 creating build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:42:49,068 copying lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:42:49,070 creating build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:42:49,071 copying lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:42:49,074 creating build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:42:49,075 copying lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:42:49,077 creating build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:42:49,078 copying lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:42:49,081 creating build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:42:49,082 copying lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:42:49,084 creating build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:42:49,085 copying lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:42:49,088 creating build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:42:49,089 copying lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:42:49,091 creating build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:42:49,092 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:42:49,095 creating build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:42:49,096 copying lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:42:49,099 creating build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:42:49,100 copying lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:42:49,102 creating build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:42:49,103 copying lm_eval/tasks/include/few_shot_en/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:42:49,106 creating build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:42:49,107 copying lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:42:49,109 creating build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:42:49,110 copying lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:42:49,113 creating build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:42:49,114 copying lm_eval/tasks/include/few_shot_en/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:42:49,116 creating build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:42:49,117 copying lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:42:49,120 creating build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:42:49,121 copying lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:42:49,124 creating build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:42:49,125 copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:42:49,127 copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:42:49,130 creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:42:49,131 copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:42:49,133 copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:42:49,136 creating build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:42:49,137 copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:42:49,139 copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:42:49,141 creating build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:42:49,142 copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:42:49,144 copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:42:49,146 creating build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:42:49,147 copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:42:49,149 copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:42:49,152 creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:42:49,154 copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:42:49,157 creating build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:42:49,158 copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:42:49,173 creating build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:42:49,174 copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:42:49,178 creating build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:42:49,179 copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:42:49,182 creating build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:42:49,183 copying lm_eval/tasks/mmlu_prox/hu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:42:49,186 creating build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:42:49,187 copying lm_eval/tasks/mmlu_prox/de/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:42:49,190 creating build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:42:49,191 copying lm_eval/tasks/mmlu_prox/vi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:42:49,193 creating build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:42:49,195 copying lm_eval/tasks/mmlu_prox/mr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:42:49,197 creating build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:42:49,198 copying lm_eval/tasks/mmlu_prox/uk/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:42:49,201 creating build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:42:49,202 copying lm_eval/tasks/mmlu_prox/cs/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:42:49,205 creating build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:42:49,206 copying lm_eval/tasks/mmlu_prox/zh/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:42:49,209 creating build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:42:49,210 copying lm_eval/tasks/mmlu_prox/ja/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:42:49,213 creating build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:42:49,214 copying lm_eval/tasks/mmlu_prox/ar/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:42:49,217 creating build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:42:49,218 copying lm_eval/tasks/mmlu_prox/bn/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:42:49,220 creating build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:42:49,222 copying lm_eval/tasks/mmlu_prox/te/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:42:49,224 creating build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:42:49,226 copying lm_eval/tasks/mmlu_prox/yo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:42:49,228 creating build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:42:49,229 copying lm_eval/tasks/mmlu_prox/af/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:42:49,231 creating build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:42:49,232 copying lm_eval/tasks/mmlu_prox/th/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:42:49,235 creating build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:42:49,236 copying lm_eval/tasks/mmlu_prox/fr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:42:49,239 creating build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:42:49,240 copying lm_eval/tasks/mmlu_prox/ne/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:42:49,242 creating build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:42:49,243 copying lm_eval/tasks/mmlu_prox/es/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:42:49,246 creating build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:42:49,247 copying lm_eval/tasks/mmlu_prox/ru/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:42:49,249 creating build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:42:49,250 copying lm_eval/tasks/mmlu_prox/ur/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:42:49,253 creating build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:42:49,254 copying lm_eval/tasks/mmlu_prox/ko/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:42:49,257 creating build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:42:49,258 copying lm_eval/tasks/mmlu_prox/sw/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:42:49,260 creating build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:42:49,262 copying lm_eval/tasks/mmlu_prox/zu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:42:49,264 creating build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:42:49,265 copying lm_eval/tasks/mmlu_prox/en/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:42:49,268 creating build/lib/lm_eval/tasks/mmlu_prox/template 2025-11-27T00:42:49,269 copying lm_eval/tasks/mmlu_prox/template/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/template 2025-11-27T00:42:49,271 creating build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:42:49,272 copying lm_eval/tasks/mmlu_prox/sr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:42:49,275 creating build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:42:49,276 copying lm_eval/tasks/mmlu_prox/id/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:42:49,279 creating build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:42:49,280 copying lm_eval/tasks/mmlu_prox/it/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:42:49,283 creating build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:42:49,284 copying lm_eval/tasks/mmlu_prox/pt/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:42:49,287 creating build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:42:49,288 copying lm_eval/tasks/mmlu_prox/wo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:42:49,291 creating build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:42:49,292 copying lm_eval/tasks/mmlu_prox/hi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:42:49,295 creating build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:42:49,297 copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:42:49,300 creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:42:49,301 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:42:49,304 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:42:49,305 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:42:49,308 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:42:49,309 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:42:49,311 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:42:49,312 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:42:49,315 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:42:49,316 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:42:49,318 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:42:49,319 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:42:49,322 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:42:49,323 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:42:49,325 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:42:49,326 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:42:49,329 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:42:49,330 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:42:49,333 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:42:49,334 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:42:49,336 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:42:49,337 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:42:49,340 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:42:49,341 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:42:49,344 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:42:49,345 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:42:49,348 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:42:49,349 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:42:49,352 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:42:49,353 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:42:49,355 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:42:49,356 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:42:49,359 creating build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:42:49,360 copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:42:49,363 creating build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:42:49,364 copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:42:49,367 creating build/lib/lm_eval/tasks/score/math 2025-11-27T00:42:49,368 copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:42:49,371 copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:42:49,374 creating build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:42:49,376 copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:42:49,378 copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:42:49,382 creating build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:42:49,383 copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:42:49,386 creating build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:42:49,388 copying lm_eval/tasks/click/click_lang/utils.py -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:42:49,391 creating build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:42:49,392 copying lm_eval/tasks/click/click_cul/utils.py -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:42:49,396 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:42:49,397 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:42:49,400 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:42:49,401 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:42:49,404 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:42:49,405 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:42:49,407 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:42:49,408 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:42:49,411 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:42:49,412 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:42:49,415 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:42:49,416 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:42:49,418 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:42:49,419 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:42:49,422 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:42:49,423 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:42:49,425 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:42:49,426 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:42:49,428 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:42:49,429 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:42:49,432 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:42:49,433 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:42:49,435 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:42:49,436 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:42:49,438 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:42:49,440 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:42:49,442 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:42:49,443 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:42:49,445 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:42:49,446 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:42:49,449 creating build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:42:49,451 copying lm_eval/tasks/noreval/ask_gec/errant.py -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:42:49,454 creating build/lib/lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:42:49,455 copying lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:42:49,457 creating build/lib/lm_eval/tasks/noreval/noridiom 2025-11-27T00:42:49,458 copying lm_eval/tasks/noreval/noridiom/utils.py -> build/lib/lm_eval/tasks/noreval/noridiom 2025-11-27T00:42:49,461 creating build/lib/lm_eval/tasks/noreval/norec 2025-11-27T00:42:49,462 copying lm_eval/tasks/noreval/norec/utils.py -> build/lib/lm_eval/tasks/noreval/norec 2025-11-27T00:42:49,465 creating build/lib/lm_eval/tasks/noreval/norsumm 2025-11-27T00:42:49,466 copying lm_eval/tasks/noreval/norsumm/utils.py -> build/lib/lm_eval/tasks/noreval/norsumm 2025-11-27T00:42:49,468 creating build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:42:49,469 copying lm_eval/tasks/noreval/norquad/utils.py -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:42:49,472 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:42:49,474 copying lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:42:49,477 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:42:49,479 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:42:49,481 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:42:49,482 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:42:49,485 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:42:49,487 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:42:49,489 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:42:49,490 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:42:49,497 creating build/lib/lm_eval/tasks/super_glue/wsc 2025-11-27T00:42:49,499 copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc 2025-11-27T00:42:49,501 copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc 2025-11-27T00:42:49,504 creating build/lib/lm_eval/tasks/super_glue/cb 2025-11-27T00:42:49,505 copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb 2025-11-27T00:42:49,507 copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb 2025-11-27T00:42:49,509 creating build/lib/lm_eval/tasks/super_glue/copa 2025-11-27T00:42:49,510 copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa 2025-11-27T00:42:49,513 creating build/lib/lm_eval/tasks/super_glue/record 2025-11-27T00:42:49,514 copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record 2025-11-27T00:42:49,516 copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record 2025-11-27T00:42:49,519 creating build/lib/lm_eval/tasks/super_glue/multirc 2025-11-27T00:42:49,520 copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc 2025-11-27T00:42:49,523 creating build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:42:49,525 copying lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:42:49,530 creating build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:42:49,531 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:42:49,536 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:42:49,537 copying lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:42:49,540 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:42:49,541 copying lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:42:49,544 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:42:49,545 copying lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:42:49,548 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:42:49,549 copying lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:42:49,552 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:42:49,553 copying lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:42:49,555 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:42:49,557 copying lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:42:49,560 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:42:49,561 copying lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:42:49,564 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:42:49,566 copying lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:42:49,569 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:42:49,570 copying lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:42:49,573 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:42:49,574 copying lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:42:49,576 creating build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:42:49,578 copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:42:49,581 copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:42:49,583 creating build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:42:49,585 copying lm_eval/tasks/aradice/winogrande/utils.py -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:42:49,587 copying lm_eval/tasks/aradice/winogrande/metrics.py -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:42:49,590 creating build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:42:49,591 copying lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:42:49,593 copying lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:42:49,596 creating build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:42:49,597 copying lm_eval/tasks/aradice/piqa/metrics.py -> build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:42:49,600 creating build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:42:49,601 copying lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:42:49,604 creating build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:42:49,606 copying lm_eval/tasks/aradice/openbookqa/utils.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:42:49,609 copying lm_eval/tasks/aradice/openbookqa/metrics.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:42:49,612 creating build/lib/lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:42:49,614 copying lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:42:49,616 copying lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:42:49,618 creating build/lib/lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:42:49,619 copying lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:42:49,621 copying lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:42:49,624 creating build/lib/lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:42:49,625 copying lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:42:49,627 copying lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:42:49,629 creating build/lib/lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:42:49,630 copying lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:42:49,632 copying lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:42:49,635 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:42:49,636 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:42:49,638 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:42:49,641 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:42:49,642 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:42:49,644 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:42:49,651 creating build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:42:49,653 copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:42:49,656 creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:42:49,658 copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:42:49,660 creating build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:42:49,661 copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:42:49,664 creating build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:42:49,665 copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:42:49,669 copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:42:49,672 copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:42:49,674 copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:42:49,676 creating build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:42:49,678 copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:42:49,680 creating build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:42:49,681 copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:42:49,684 creating build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:42:49,686 copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:42:49,688 creating build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:42:49,689 copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:42:49,692 creating build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:42:49,693 copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:42:49,698 creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:42:49,699 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:42:49,702 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:42:49,704 copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:42:49,708 creating build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:42:49,710 copying lm_eval/tasks/global_mmlu/default/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:42:49,713 creating build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:42:49,714 copying lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:42:49,716 creating build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:42:49,717 copying lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:42:49,720 creating build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:42:49,721 copying lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:42:49,723 creating build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:42:49,724 copying lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:42:49,727 creating build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:42:49,728 copying lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:42:49,730 creating build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:42:49,731 copying lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:42:49,733 creating build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:42:49,735 copying lm_eval/tasks/global_mmlu/default/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:42:49,737 creating build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:42:49,738 copying lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:42:49,740 creating build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:42:49,741 copying lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:42:49,744 creating build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:42:49,745 copying lm_eval/tasks/global_mmlu/default/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:42:49,747 creating build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:42:49,749 copying lm_eval/tasks/global_mmlu/default/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:42:49,751 creating build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:42:49,752 copying lm_eval/tasks/global_mmlu/default/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:42:49,755 creating build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:42:49,756 copying lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:42:49,759 creating build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:42:49,760 copying lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:42:49,763 creating build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:42:49,765 copying lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:42:49,767 creating build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:42:49,769 copying lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:42:49,772 creating build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:42:49,773 copying lm_eval/tasks/global_mmlu/full/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:42:49,776 creating build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:42:49,777 copying lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:42:49,779 creating build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:42:49,781 copying lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:42:49,783 creating build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:42:49,784 copying lm_eval/tasks/global_mmlu/full/el/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:42:49,787 creating build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:42:49,789 copying lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:42:49,791 creating build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:42:49,792 copying lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:42:49,795 creating build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:42:49,796 copying lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:42:49,799 creating build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:42:49,800 copying lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:42:49,802 creating build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:42:49,803 copying lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:42:49,806 creating build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:42:49,807 copying lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:42:49,810 creating build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:42:49,811 copying lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:42:49,814 creating build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:42:49,815 copying lm_eval/tasks/global_mmlu/full/he/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:42:49,817 creating build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:42:49,818 copying lm_eval/tasks/global_mmlu/full/am/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:42:49,821 creating build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:42:49,822 copying lm_eval/tasks/global_mmlu/full/te/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:42:49,825 creating build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:42:49,826 copying lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:42:49,829 creating build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:42:49,830 copying lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:42:49,832 creating build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:42:49,833 copying lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:42:49,836 creating build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:42:49,837 copying lm_eval/tasks/global_mmlu/full/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:42:49,840 creating build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:42:49,841 copying lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:42:49,844 creating build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:42:49,845 copying lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:42:49,848 creating build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:42:49,849 copying lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:42:49,852 creating build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:42:49,853 copying lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:42:49,856 creating build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:42:49,857 copying lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:42:49,860 creating build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:42:49,861 copying lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:42:49,863 creating build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:42:49,864 copying lm_eval/tasks/global_mmlu/full/so/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:42:49,867 creating build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:42:49,868 copying lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:42:49,871 creating build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:42:49,872 copying lm_eval/tasks/global_mmlu/full/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:42:49,874 creating build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:42:49,875 copying lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:42:49,878 creating build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:42:49,879 copying lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:42:49,882 creating build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:42:49,883 copying lm_eval/tasks/global_mmlu/full/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:42:49,885 creating build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:42:49,886 copying lm_eval/tasks/global_mmlu/full/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:42:49,889 creating build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:42:49,890 copying lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:42:49,893 creating build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:42:49,894 copying lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:42:49,896 creating build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:42:49,897 copying lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:42:49,900 creating build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:42:49,901 copying lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:42:49,903 creating build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:42:49,905 copying lm_eval/tasks/global_mmlu/full/si/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:42:49,907 creating build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:42:49,909 copying lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:42:49,911 creating build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:42:49,912 copying lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:42:49,915 creating build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:42:49,916 copying lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:42:49,919 creating build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:42:49,920 copying lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:42:49,925 creating build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:42:49,926 copying lm_eval/tasks/hrm8k/default/utils.py -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:42:49,929 creating build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:42:49,931 copying lm_eval/tasks/hrm8k/en/utils.py -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:42:49,934 creating build/lib/lm_eval/tasks/glue/mnli 2025-11-27T00:42:49,936 copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli 2025-11-27T00:42:49,940 creating build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:42:49,942 copying lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:42:49,945 creating build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:42:49,946 copying lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:42:49,948 creating build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:42:49,949 copying lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:42:49,952 creating build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:42:49,953 copying lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:42:49,955 creating build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:42:49,957 copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:42:49,959 copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:42:49,962 creating build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:42:49,964 copying lm_eval/tasks/global_piqa/prompted/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:42:49,966 creating build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:42:49,967 copying lm_eval/tasks/global_piqa/completions/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:42:49,970 creating build/lib/lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:42:49,971 copying lm_eval/tasks/eq_bench/multilingual/utils.py -> build/lib/lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:42:49,974 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:42:49,976 copying lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:42:49,979 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:42:49,980 copying lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:42:49,983 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:42:49,984 copying lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:42:49,987 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:42:49,988 copying lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:42:49,991 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:42:49,992 copying lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:42:49,996 creating build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:42:49,997 copying lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:42:50,000 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:42:50,001 copying lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:42:50,004 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:42:50,005 copying lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:42:50,008 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:42:50,009 copying lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:42:50,012 creating build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:42:50,014 copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:42:50,017 creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:42:50,018 copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:42:50,021 creating build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:42:50,022 copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:42:50,025 creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:42:50,026 copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:42:50,028 creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:42:50,029 copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:42:50,040 running egg_info 2025-11-27T00:42:50,051 writing lm_eval.egg-info/PKG-INFO 2025-11-27T00:42:50,082 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2025-11-27T00:42:50,084 writing entry points to lm_eval.egg-info/entry_points.txt 2025-11-27T00:42:50,100 writing requirements to lm_eval.egg-info/requires.txt 2025-11-27T00:42:50,102 writing top-level names to lm_eval.egg-info/top_level.txt 2025-11-27T00:42:52,806 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:53,509 reading manifest template 'MANIFEST.in' 2025-11-27T00:42:53,510 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2025-11-27T00:42:53,511 adding license file 'LICENSE.md' 2025-11-27T00:42:55,127 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2025-11-27T00:42:59,066 copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande 2025-11-27T00:42:59,068 creating build/lib/lm_eval/tasks/wmdp 2025-11-27T00:42:59,069 copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:42:59,072 copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:42:59,074 copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:42:59,076 copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:42:59,078 creating build/lib/lm_eval/tasks/storycloze 2025-11-27T00:42:59,079 copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze 2025-11-27T00:42:59,082 copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze 2025-11-27T00:42:59,084 creating build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,085 copying lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,087 copying lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,090 copying lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,092 copying lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,094 copying lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,096 copying lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,099 copying lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,101 copying lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,103 copying lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,106 copying lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,108 copying lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,110 copying lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,112 copying lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,114 copying lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,117 copying lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,119 copying lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,121 copying lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,123 copying lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,125 copying lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,128 copying lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,130 copying lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,132 copying lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,134 copying lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,136 copying lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,138 copying lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,140 copying lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,142 copying lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,144 copying lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,146 copying lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,149 copying lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,151 copying lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,153 copying lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,155 copying lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,157 copying lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,159 copying lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,162 copying lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,164 copying lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,166 copying lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,168 copying lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,171 copying lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,173 copying lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,175 copying lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,177 copying lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,180 copying lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,182 copying lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,184 copying lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,187 copying lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,189 copying lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,191 copying lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,193 copying lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,195 copying lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,198 copying lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,200 copying lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,202 copying lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,204 copying lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,206 copying lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,209 copying lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,211 copying lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,213 copying lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,215 copying lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,218 copying lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,220 copying lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,222 copying lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,224 copying lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,226 copying lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,229 copying lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,230 copying lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,233 copying lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,235 copying lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,237 copying lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,239 copying lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,241 copying lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,243 copying lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,245 copying lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,247 copying lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,250 copying lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,252 copying lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,254 copying lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,256 copying lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,258 copying lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,260 copying lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,263 copying lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,265 copying lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,267 copying lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,269 copying lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,271 copying lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,273 copying lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,275 copying lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,277 copying lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,279 copying lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,281 copying lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,283 copying lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,285 copying lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,287 copying lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,289 copying lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,291 copying lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,293 copying lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,295 copying lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,297 copying lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,299 copying lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,301 copying lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:42:59,303 copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa 2025-11-27T00:42:59,305 copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,307 copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,310 copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,312 copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,314 copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,316 copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,318 copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,320 copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,323 copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,325 copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,327 copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,330 copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,332 copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,334 copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,336 copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,338 copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,340 copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,342 copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:42:59,344 copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,347 copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,349 copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,351 copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,353 copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,355 copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,357 copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,360 copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,362 copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,364 copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,366 copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,368 copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,370 copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,372 copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,374 copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:42:59,376 copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa 2025-11-27T00:42:59,379 creating build/lib/lm_eval/tasks/nq_open 2025-11-27T00:42:59,380 copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open 2025-11-27T00:42:59,382 copying lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,384 copying lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,386 copying lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,389 copying lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,391 copying lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,393 copying lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,395 copying lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,398 copying lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,400 copying lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,402 copying lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,404 copying lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,406 copying lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,409 copying lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,411 copying lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,413 copying lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,415 copying lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,417 copying lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,419 copying lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:42:59,421 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,424 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,426 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,428 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,430 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,432 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,434 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,437 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,439 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,441 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,443 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,445 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,447 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,449 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,452 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,454 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,456 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,459 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:42:59,461 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,463 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,465 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,467 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,469 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,471 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,473 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,475 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,478 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,480 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,482 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,484 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,486 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,489 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,491 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,493 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,495 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:42:59,497 copying lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/lib/lm_eval/tasks/afrixnli/direct 2025-11-27T00:42:59,500 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,502 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,504 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,506 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,508 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,510 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,512 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,514 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,516 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,519 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,521 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,523 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,525 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,527 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,530 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,532 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,534 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,536 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:42:59,538 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,540 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,542 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,544 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,546 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,548 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,551 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,553 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,555 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,557 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,559 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,561 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,563 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,565 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,567 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,570 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,572 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,574 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:42:59,576 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,578 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,580 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,582 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,585 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,587 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,589 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,591 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,593 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,595 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,597 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,599 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,601 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,603 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,605 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,608 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,610 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,612 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:42:59,614 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,616 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,618 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,620 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,622 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,624 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,626 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,629 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,631 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,633 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,635 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,637 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,639 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,642 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,644 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,646 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,648 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,650 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:42:59,652 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,654 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,656 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,658 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,660 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,662 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,665 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,667 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,669 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,671 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,673 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,675 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,677 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,680 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,682 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,684 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,686 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,688 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:42:59,691 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,693 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,695 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,697 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,699 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,702 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,704 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,706 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,708 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,710 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,712 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,714 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,717 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,719 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,721 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,723 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,726 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,728 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:42:59,730 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,732 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,734 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,736 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,739 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,741 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,743 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,745 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,747 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,749 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,752 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,754 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,756 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,758 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,761 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,763 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,765 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,767 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:42:59,769 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,771 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,773 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,775 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,777 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,780 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,782 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,784 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,786 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,788 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,791 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,793 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,795 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,797 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,799 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,802 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,804 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:42:59,806 copying lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/lib/lm_eval/tasks/afrixnli/translate 2025-11-27T00:42:59,809 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,811 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,813 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,815 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,817 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,819 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,821 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,823 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,825 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,828 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,830 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,832 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,834 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,836 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,839 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,841 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,843 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:42:59,845 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,847 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,849 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,852 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,854 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,856 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,858 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,860 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,863 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,865 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,867 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,869 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,871 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,873 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,875 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,877 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,879 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:42:59,881 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,883 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,885 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,887 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,889 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,892 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,894 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,896 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,898 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,900 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,902 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,904 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,906 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,908 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,910 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,912 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,914 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:42:59,916 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,918 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,921 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,923 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,925 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,927 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,929 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,930 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,932 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,934 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,936 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,938 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,940 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,942 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,944 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,946 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,948 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:42:59,950 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,953 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,955 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,957 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,959 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,961 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,963 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,966 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,968 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,970 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,972 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,975 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,977 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,979 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,981 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,983 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,985 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:42:59,988 copying lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/lib/lm_eval/tasks/afrobench 2025-11-27T00:42:59,990 copying lm_eval/tasks/afrobench/afrobench.yaml -> build/lib/lm_eval/tasks/afrobench 2025-11-27T00:42:59,992 copying lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti 2025-11-27T00:42:59,994 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:42:59,996 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:42:59,999 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:00,001 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:00,003 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:00,005 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:00,007 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:00,010 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:00,012 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:00,014 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:00,016 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:00,018 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:00,021 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:00,023 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:00,025 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:00,027 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:00,029 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:00,031 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:00,033 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:00,036 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:00,038 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:00,040 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:00,042 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:00,044 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:00,046 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:00,048 copying lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:00,050 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:00,051 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:00,053 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:00,055 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:00,057 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:00,059 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:00,061 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:00,063 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:00,065 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:00,066 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:00,068 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:00,070 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:00,072 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:00,073 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:00,076 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:00,078 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:00,080 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:00,081 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:00,083 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:00,085 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:00,087 copying lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:00,090 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,091 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,094 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,096 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,098 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,101 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,103 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,105 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,107 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,109 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,112 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,114 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,116 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,118 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,120 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,123 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,125 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,127 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,129 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,131 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,133 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,136 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,138 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,140 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,142 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,144 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,146 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,149 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,151 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,153 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,155 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,157 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,159 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:00,161 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,162 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,164 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,167 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,169 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,171 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,173 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,175 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,178 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,180 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,183 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,185 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,187 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,190 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,192 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,194 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,197 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,200 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,203 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,205 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,207 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,209 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,211 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,214 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,216 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,218 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,220 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,222 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,224 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,226 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,229 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,231 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,233 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:00,235 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,237 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,240 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,242 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,244 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,246 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,248 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,250 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,253 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,255 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,257 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,259 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,261 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,263 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,265 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,267 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,269 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,272 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,274 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,276 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,278 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,280 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,282 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,284 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,286 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,289 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,291 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,293 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,295 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,297 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,299 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,301 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,303 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:00,305 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,306 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,309 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,311 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,313 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,315 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,317 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,319 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,322 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,324 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,326 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,328 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,331 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,333 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,335 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,338 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,340 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,342 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,344 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,346 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,348 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,351 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,353 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,355 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,357 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,359 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,361 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,364 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,366 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,369 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,371 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,373 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,375 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:00,377 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,379 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,381 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,384 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,386 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,388 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,391 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,393 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,395 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,397 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,400 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,402 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,404 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,406 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,408 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,411 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,413 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,415 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,418 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,420 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,422 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,424 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,426 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,428 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,431 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,433 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,435 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,437 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,439 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,441 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,443 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,445 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,448 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:00,450 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,451 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,453 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,455 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,458 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,460 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,463 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,465 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,467 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,469 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,471 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,474 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,476 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,478 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,481 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,483 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,485 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,487 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,490 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,492 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,494 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,496 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,499 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,501 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,503 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,506 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,508 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,510 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,512 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,515 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,517 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,519 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,521 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:00,524 copying lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/lib/lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:00,526 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,528 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,530 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,532 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,534 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,537 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,539 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,541 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,543 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,545 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,547 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,549 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,551 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,553 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,555 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,557 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,559 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,561 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,563 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,566 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,568 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:00,570 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,572 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,574 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,576 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,578 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,581 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,583 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,585 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,587 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,589 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,591 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,594 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,596 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,598 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,600 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,602 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,605 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,607 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,609 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,611 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,613 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:00,615 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,617 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,620 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,622 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,624 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,626 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,628 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,630 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,633 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,635 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,637 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,639 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,641 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,643 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,645 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,647 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,649 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,651 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,653 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,655 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,657 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:00,659 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,662 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,664 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,666 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,668 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,670 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,672 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,674 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,676 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,678 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,681 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,683 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,685 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,687 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,689 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,691 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,693 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,695 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,697 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,699 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,701 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:00,703 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,705 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,707 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,709 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,712 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,714 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,716 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,718 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,721 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,723 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,725 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,727 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,729 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,731 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,733 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,735 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,737 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,740 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,742 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,744 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,746 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:00,748 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,750 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,753 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,755 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,757 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,759 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,761 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,764 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,766 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,768 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,770 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,772 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,775 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,777 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,779 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,782 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,784 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,786 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,788 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,790 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,792 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:00,794 copying lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/lib/lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:00,796 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,797 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,800 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,802 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,804 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,806 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,808 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,811 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,813 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,815 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,817 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,819 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,821 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,824 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,826 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,828 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,830 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,832 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,834 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,837 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,839 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,841 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,843 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,845 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,847 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,849 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,851 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,853 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,855 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,857 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,859 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,862 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:00,864 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,865 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,867 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,869 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,871 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,873 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,875 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,877 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,879 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,881 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,884 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,886 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,888 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,890 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,892 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,895 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,897 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,899 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,902 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,904 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,906 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,908 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,910 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,912 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,914 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,916 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,919 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,921 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,923 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,925 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,927 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,929 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:00,932 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,933 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,935 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,937 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,939 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,942 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,944 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,946 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,948 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,951 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,953 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,955 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,957 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,959 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,961 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,963 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,965 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,968 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,970 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,972 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,974 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,976 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,978 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,980 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,982 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,985 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,987 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,989 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,991 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,993 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,995 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,997 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:00,999 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,000 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,002 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,004 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,006 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,009 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,011 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,013 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,015 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,017 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,019 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,021 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,023 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,025 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,027 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,029 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,031 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,033 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,035 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,037 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,039 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,041 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,043 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,045 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,048 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,050 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,052 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,054 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,056 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,059 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,061 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,063 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:01,065 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,066 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,068 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,070 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,072 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,074 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,076 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,078 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,080 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,082 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,084 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,086 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,088 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,090 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,093 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,095 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,097 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,099 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,101 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,104 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,106 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,108 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,110 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,112 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,115 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,117 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,119 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,121 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,123 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,125 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,127 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,129 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:01,131 copying lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:01,134 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,136 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,138 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,140 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,142 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,144 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,146 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,149 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,151 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,153 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,155 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,157 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,160 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,162 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,164 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,166 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,169 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:01,171 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,173 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,175 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,177 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,179 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,182 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,184 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,186 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,188 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,190 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,192 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,195 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,197 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,199 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,201 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,203 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,205 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:01,207 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,210 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,212 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,214 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,216 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,218 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,220 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,222 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,224 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,226 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,228 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,230 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,233 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,235 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,237 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,239 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,241 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:01,243 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,245 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,247 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,249 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,251 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,253 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,255 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,257 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,259 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,261 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,263 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,265 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,267 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,269 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,271 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,273 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,275 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:01,277 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,279 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,282 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,284 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,286 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,288 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,290 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,292 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,294 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,296 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,298 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,300 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,302 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,304 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,306 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,308 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,310 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:01,312 copying lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:01,314 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:01,315 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:01,317 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:01,319 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:01,321 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:01,322 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:01,324 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:01,326 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:01,328 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:01,329 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:01,332 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:01,334 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:01,336 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:01,337 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:01,339 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:01,341 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:01,343 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:01,344 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:01,346 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:01,348 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:01,350 copying lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/lib/lm_eval/tasks/afrobench/adr 2025-11-27T00:43:01,352 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,353 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,355 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,357 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,359 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,361 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:01,363 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,364 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,366 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,368 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,370 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,372 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:01,374 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,375 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,377 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,379 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,381 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,383 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:01,385 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,386 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,388 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,391 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,393 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,395 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:01,397 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,398 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,400 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,402 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,404 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,406 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:01,408 copying lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:01,410 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,412 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,414 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,416 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,418 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,420 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,422 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:01,424 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,426 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,428 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,430 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,432 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,434 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,436 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:01,438 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,440 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,442 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,444 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,446 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,448 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,450 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:01,452 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,454 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,456 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,458 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,460 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,462 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,464 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:01,466 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,468 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,470 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,472 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,474 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,476 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,478 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:01,480 copying lm_eval/tasks/afrobench/salt/salt.yaml -> build/lib/lm_eval/tasks/afrobench/salt 2025-11-27T00:43:01,482 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,483 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,485 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,487 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,489 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,491 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,493 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,495 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,497 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,500 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,502 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,504 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,506 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,508 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,510 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:01,511 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,512 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,515 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,516 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,519 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,521 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,523 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,525 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,527 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,529 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,531 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,533 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,535 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,537 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,539 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:01,541 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,542 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,545 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,547 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,549 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,551 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,553 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,555 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,557 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,559 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,561 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,563 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,565 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,567 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,569 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:01,571 copying lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:01,573 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,575 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,577 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,579 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,581 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,583 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,585 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,587 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,590 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,592 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,594 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,596 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,598 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,600 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:01,602 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,604 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,606 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,608 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,612 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,614 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,616 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,618 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,620 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,622 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,624 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,626 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,628 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,630 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:01,632 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,634 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,637 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,639 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,641 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,643 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,645 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,647 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,649 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,651 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,654 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,656 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,658 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,660 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:01,662 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,664 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,666 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,669 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,671 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,673 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,674 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,676 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,678 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,680 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,682 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,684 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,686 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,688 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:01,690 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,692 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,694 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,696 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,699 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,701 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,703 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,705 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,707 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,709 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,711 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,713 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,716 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,718 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:01,720 copying lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:01,722 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,724 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,726 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,728 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,730 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,732 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,735 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,737 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,739 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,740 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,743 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,745 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,747 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,749 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,751 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,753 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,755 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,757 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,759 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,761 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:01,763 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,765 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,768 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,770 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,772 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,774 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,776 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,778 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,780 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,782 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,784 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,786 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,788 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,790 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,792 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,794 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,796 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,798 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,800 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,802 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:01,804 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,806 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,808 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,810 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,812 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,815 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,817 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,819 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,821 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,823 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,825 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,827 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,829 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,831 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,834 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,836 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,838 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,840 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,842 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,844 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:01,845 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,847 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,850 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,852 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,854 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,856 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,858 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,860 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,862 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,864 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,866 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,868 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,870 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,872 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,874 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,877 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,879 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,881 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,883 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,885 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:01,887 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,890 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,892 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,894 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,896 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,898 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,900 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,902 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,904 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,906 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,908 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,910 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,912 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,915 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,917 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,919 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,921 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,923 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,925 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,927 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:01,929 copying lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:01,931 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,934 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,936 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,938 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,940 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,942 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,944 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,947 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,949 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,951 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,953 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,955 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,957 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,959 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,961 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,963 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,965 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,967 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,969 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,971 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:01,974 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,976 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,978 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,980 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,982 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,984 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,986 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,989 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,991 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,993 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,995 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,997 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:01,999 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,001 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,003 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,005 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,007 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,009 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,011 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,013 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:02,015 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,017 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,020 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,022 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,024 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,026 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,028 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,030 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,033 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,035 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,037 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,039 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,041 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,043 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,045 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,047 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,049 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,051 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,053 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,056 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:02,058 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,060 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,062 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,064 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,066 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,068 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,070 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,072 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,074 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,076 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,078 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,080 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,082 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,084 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,087 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,089 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,091 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,093 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,095 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,097 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:02,100 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,102 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,104 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,106 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,109 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,111 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,113 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,115 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,118 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,120 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,122 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,124 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,126 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,128 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,130 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,132 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,134 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,137 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,139 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,141 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:02,143 copying lm_eval/tasks/afrobench/flores/flores.yaml -> build/lib/lm_eval/tasks/afrobench/flores 2025-11-27T00:43:02,145 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,146 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,148 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,150 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,153 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,155 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,157 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,159 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,161 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,163 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,165 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,167 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,169 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,171 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,173 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,175 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,177 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,179 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,181 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,183 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,185 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,188 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,190 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,192 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,194 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,196 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,198 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,200 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,202 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,204 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,206 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,209 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,211 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,213 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,215 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,217 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,219 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,221 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,223 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,225 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,227 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,229 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,231 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,233 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,236 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,238 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,240 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,242 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,244 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,246 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,248 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,250 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,252 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,255 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,257 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,259 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,261 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,263 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,265 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,267 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,269 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,271 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,273 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:02,275 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,276 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,278 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,280 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,282 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,284 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,287 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,289 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,291 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,293 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,295 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,297 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,299 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,301 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,304 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,305 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,307 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,309 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,311 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,313 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,315 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,318 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,320 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,322 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,324 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,326 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,328 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,330 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,332 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,334 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,336 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,338 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,340 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,342 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,345 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,347 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,349 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,351 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,353 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,355 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,357 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,359 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,362 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,363 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,366 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,368 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,370 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,372 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,374 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,376 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,379 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,381 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,383 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,385 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,387 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,389 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,391 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,394 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,396 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,398 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,400 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,402 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,404 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:02,406 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,407 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,409 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,411 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,413 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,415 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,418 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,420 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,423 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,425 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,427 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,429 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,431 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,433 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,435 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,438 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,440 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,442 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,444 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,446 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,448 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,450 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,452 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,454 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,456 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,458 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,461 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,463 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,465 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,467 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,469 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,471 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,473 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,475 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,478 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,480 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,482 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,484 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,486 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,489 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,491 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,493 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,495 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,497 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,499 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,501 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,503 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,505 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,507 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,509 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,511 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,513 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,516 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,518 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,520 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,522 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,524 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,526 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,528 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,530 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,532 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,534 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,536 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:02,538 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,539 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,542 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,544 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,546 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,548 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,550 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,552 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,554 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,556 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,558 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,561 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,563 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,565 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,567 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,569 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,571 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,573 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,575 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,578 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,580 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,582 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,584 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,586 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,588 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,590 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,592 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,594 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,596 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,598 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,600 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,603 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,605 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,607 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,609 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,611 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,613 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,615 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,617 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,620 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,622 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,624 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,626 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,628 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,630 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,632 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,634 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,636 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,638 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,641 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,643 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,645 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,647 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,649 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,651 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,653 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,656 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,658 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,660 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,662 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,664 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,666 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,669 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:02,671 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,672 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,674 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,677 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,679 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,681 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,683 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,685 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,687 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,689 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,691 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,693 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,695 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,697 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,700 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,702 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,704 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,706 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,708 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,710 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,713 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,715 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,717 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,719 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,722 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,724 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,726 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,728 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,730 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,732 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,735 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,737 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,739 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,742 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,744 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,746 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,748 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,751 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,753 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,755 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,757 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,760 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,762 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,764 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,767 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,769 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,771 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,773 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,775 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,777 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,779 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,782 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,784 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,786 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,788 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,790 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,792 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,794 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,796 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,799 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,801 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,803 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,805 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:02,808 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,809 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,811 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,813 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,815 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,818 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,820 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,822 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,824 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,826 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,828 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,830 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,833 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,835 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,837 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,839 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,842 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,844 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,846 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,849 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,851 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,854 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,856 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,858 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,860 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,863 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,865 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,867 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,869 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,871 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,873 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,875 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,878 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,880 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,882 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,884 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,887 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,889 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,891 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,893 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,895 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,897 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,900 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,902 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,904 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,906 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,909 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,911 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,913 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,915 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,917 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,919 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,921 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,923 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,925 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,927 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,930 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,932 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,934 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,936 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,938 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,941 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,943 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:02,945 copying lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:02,947 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,950 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,952 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,954 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,957 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,959 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,961 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,963 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,965 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:02,967 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,969 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,972 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,974 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,976 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,978 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,980 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,982 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,985 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:02,987 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:02,989 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:02,991 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:02,993 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:02,996 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:02,998 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:03,000 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:03,003 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:03,005 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:03,007 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,009 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,012 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,014 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,016 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,019 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,021 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,023 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,025 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:03,027 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,030 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,032 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,034 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,036 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,038 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,040 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,043 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,045 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:03,047 copying lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:03,049 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,051 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,054 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,056 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,059 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,061 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,063 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,066 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,068 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,070 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,072 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,074 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:03,077 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,079 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,081 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,084 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,086 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,088 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,090 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,093 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,095 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,097 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,099 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,102 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:03,104 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,106 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,108 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,111 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,113 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,115 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,117 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,120 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,122 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,124 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,127 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,129 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:03,131 copying lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:03,134 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,136 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,139 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,141 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,143 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,145 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,148 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,150 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,152 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,155 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,157 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,159 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,161 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,164 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,166 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,168 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:03,170 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,173 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,175 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,177 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,179 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,182 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,184 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,186 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,189 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,191 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,193 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,196 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,198 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,201 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,203 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,205 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:03,208 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,210 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,212 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,214 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,216 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,219 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,221 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,223 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,225 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,227 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,229 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,232 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,234 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,236 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,238 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,241 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:03,243 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,245 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,247 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,250 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,252 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,254 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,256 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,259 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,261 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,264 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,266 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,268 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,270 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,273 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,275 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,277 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:03,279 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,281 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,284 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,286 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,288 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,290 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,292 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,295 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,297 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,299 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,301 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,304 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,306 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,308 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,310 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,312 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:03,315 copying lm_eval/tasks/afrobench/sib/sib.yaml -> build/lib/lm_eval/tasks/afrobench/sib 2025-11-27T00:43:03,317 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,319 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,321 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,324 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,326 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,328 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,331 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,333 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,335 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,337 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,340 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,342 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,344 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,346 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,349 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,351 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,353 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,355 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,357 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,360 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,362 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,364 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,367 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,369 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,371 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,374 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,376 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,378 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,381 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,383 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,386 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,388 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,391 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,393 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,396 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,398 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,401 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,403 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,406 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,408 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,411 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,413 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,416 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,418 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,421 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,423 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,426 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,428 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,431 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,433 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,436 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,438 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,441 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,443 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,446 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,449 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:03,451 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,454 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,456 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,459 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,461 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,464 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,466 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,469 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,471 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,474 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,477 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,479 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,482 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,484 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,487 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,489 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,492 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,495 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,497 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,500 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,502 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,505 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,507 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,510 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,513 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,515 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,518 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,520 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,522 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,525 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,527 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,530 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,532 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,534 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,537 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,539 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,542 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,544 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,547 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,549 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,552 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,554 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,557 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,559 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,562 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,564 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,567 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,569 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,572 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,574 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,577 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,579 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,582 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,584 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,587 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,589 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:03,592 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,594 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,597 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,599 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,602 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,604 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,607 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,609 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,612 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,615 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,617 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,620 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,623 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,625 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,628 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,630 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,633 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,635 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,638 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,640 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,642 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,645 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,647 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,649 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,651 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,654 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,656 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,658 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,660 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,663 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,665 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,667 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,669 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,672 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,674 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,676 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,678 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,681 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,683 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,685 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,688 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,690 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,692 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,695 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,697 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,699 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,702 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,704 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,706 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,709 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,711 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,713 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,715 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,718 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,720 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,722 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:03,725 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,727 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,729 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,731 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,734 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,736 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,738 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,740 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,742 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,745 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,747 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,749 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,751 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,753 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,756 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,758 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,760 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,762 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,764 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,767 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,769 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,771 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,773 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,775 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,777 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,779 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,781 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,784 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,786 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,788 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,790 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,792 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,794 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,796 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,798 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,801 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,803 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,805 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,807 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,810 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,812 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,814 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,816 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,819 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,821 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,823 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,826 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,828 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,830 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,832 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,835 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,837 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,839 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,842 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,844 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,846 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:03,849 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,851 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,853 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,855 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,858 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,860 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,863 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,865 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,867 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,869 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,872 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,874 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,876 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,879 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,881 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,883 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,886 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,888 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,890 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,893 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,896 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,899 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,902 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,905 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,908 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,911 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,914 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,917 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,920 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,923 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,925 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,928 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,931 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,934 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,937 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,940 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,943 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,945 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,948 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,951 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,954 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,957 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,960 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,963 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,966 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,970 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,973 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,976 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,979 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,982 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,984 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,987 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,990 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,993 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,995 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:03,998 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:04,001 copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,003 copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,005 copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,009 copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,011 copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,013 copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,015 copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,017 copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:04,020 copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,022 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,024 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,026 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,029 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,031 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,033 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,035 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,037 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:04,039 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:04,042 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:04,044 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:04,047 copying lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:04,050 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:04,052 copying lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:04,055 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:04,058 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:04,060 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:04,062 copying lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2025-11-27T00:43:04,065 copying lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2025-11-27T00:43:04,067 copying lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:04,069 copying lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:04,071 copying lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,074 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,076 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,078 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,080 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,082 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,085 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:04,087 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,089 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,091 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,093 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,095 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,098 copying lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,100 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,102 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,104 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:04,106 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,109 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,111 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,113 copying lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,115 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,118 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,120 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,122 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:04,125 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:04,127 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:04,129 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:04,131 copying lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:04,134 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:04,136 copying lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:04,138 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:04,140 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:04,142 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,144 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,147 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,149 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,151 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,153 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,155 copying lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:04,158 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:04,160 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:04,162 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:04,164 copying lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:04,167 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,169 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,171 copying lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,173 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,175 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,177 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:04,180 copying lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:04,182 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:04,184 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:04,186 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:04,189 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,191 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,193 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,195 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,198 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,200 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,202 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,204 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,206 copying lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:04,209 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,211 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,213 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,215 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,217 copying lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,219 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:04,221 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,223 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,226 copying lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,228 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,230 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,232 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,235 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,237 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,239 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:04,241 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:04,243 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:04,245 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:04,247 copying lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:04,250 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,252 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,254 copying lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,256 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,259 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,261 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:04,263 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:04,265 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:04,267 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:04,270 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:04,272 copying lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:04,274 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,276 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,279 copying lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,281 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,283 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,286 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:04,288 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,290 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,292 copying lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,294 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,296 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,299 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,301 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:04,303 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:04,305 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:04,307 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:04,309 copying lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:04,311 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:04,313 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:04,315 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:04,317 copying lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:04,320 copying lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:43:04,322 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:43:04,324 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:43:04,326 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:04,328 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:04,330 copying lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:04,332 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:04,335 copying lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:04,337 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:04,339 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:04,342 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,344 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,346 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,348 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,350 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,352 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,354 copying lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:04,356 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:04,358 copying lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:04,360 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:04,362 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:04,365 copying lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:04,367 copying lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:04,369 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:04,371 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:04,373 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:04,375 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:04,377 copying lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:04,380 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:04,382 copying lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:04,384 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:04,386 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:04,388 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:04,390 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,393 copying lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,395 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,397 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,399 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,401 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:04,403 copying lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:04,405 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:04,407 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:04,409 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:04,411 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:04,413 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:04,416 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:04,418 copying lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:04,420 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:04,422 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:04,424 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:04,426 copying lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:04,428 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,430 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,432 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,434 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,436 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,439 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,441 copying lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:04,443 copying lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:04,446 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:04,448 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:04,450 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:04,452 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:04,454 copying lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:04,456 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:04,458 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:04,460 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:04,462 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:04,464 copying lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:43:04,466 copying lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:43:04,468 copying lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:43:04,470 copying lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:43:04,472 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:04,475 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:04,477 copying lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:04,479 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,481 copying lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,483 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,485 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,487 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,489 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:04,491 copying lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,493 copying lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,496 copying lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,498 copying lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,500 copying lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,502 copying lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:04,504 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:04,506 copying lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:04,508 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:04,510 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,511 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,513 copying lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,516 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,518 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,520 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:04,522 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:04,525 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:04,527 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:04,529 copying lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:04,531 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:04,534 copying lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:04,536 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:04,538 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:04,540 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:04,542 copying lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:04,545 copying lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:04,547 copying lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:04,549 copying lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:04,551 copying lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,553 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,555 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,557 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,559 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,561 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,563 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:04,565 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,567 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,569 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,571 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,574 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,576 copying lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,578 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,580 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,582 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:04,584 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,586 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,588 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,590 copying lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,592 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,594 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,597 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,599 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:04,601 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:04,603 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:04,605 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:04,607 copying lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:04,609 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:04,611 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:04,613 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:04,615 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:04,617 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,619 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,621 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,623 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,625 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,627 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,629 copying lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:04,631 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:04,634 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:04,636 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:04,638 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:04,640 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,642 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,644 copying lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,646 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,648 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,650 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:04,652 copying lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:04,654 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:04,656 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:04,658 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:04,660 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,662 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,664 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,667 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,669 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,671 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,673 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,675 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,677 copying lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:04,679 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,681 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,683 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,686 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,688 copying lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,690 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:04,692 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,694 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,696 copying lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,698 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,700 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,702 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,704 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,706 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,709 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:04,711 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:04,713 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:04,715 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:04,717 copying lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:04,719 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,721 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,723 copying lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,725 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,727 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,729 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:04,731 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:04,733 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:04,736 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:04,738 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:04,740 copying lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:04,742 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,744 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,746 copying lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,748 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,750 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,752 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:04,754 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,756 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,758 copying lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,760 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,762 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,764 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,766 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:04,768 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:04,770 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:04,772 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:04,774 copying lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:04,776 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:04,778 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:04,780 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:04,783 copying lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:04,785 copying lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:04,787 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:04,789 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:04,791 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:04,793 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:04,795 copying lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:04,797 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:04,799 copying lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:04,801 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:04,803 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:04,805 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,807 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,809 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,811 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,813 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,815 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,817 copying lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:04,819 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:04,821 copying lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:04,824 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:04,826 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:04,828 copying lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:04,830 copying lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:04,832 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:04,834 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:04,836 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:04,838 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:04,840 copying lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:04,842 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:04,844 copying lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:04,846 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:04,848 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:04,850 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:04,852 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,854 copying lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,856 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,858 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,860 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,862 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:04,864 copying lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:04,867 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:04,869 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:04,871 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:04,873 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:04,875 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:04,877 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:04,879 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:04,881 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:04,883 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:04,885 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:04,887 copying lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:04,890 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,892 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,894 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,896 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,898 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,900 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,902 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:04,904 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:04,906 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:04,908 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:04,910 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:04,913 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:04,915 copying lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:04,917 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:04,919 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:04,921 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:04,923 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:04,925 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:04,927 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:04,930 copying lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:04,932 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:04,934 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:04,936 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:04,939 copying lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:04,941 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,943 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,945 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,947 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,949 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,951 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:04,953 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,956 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,958 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,960 copying lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,962 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,964 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:04,966 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:04,968 copying lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:04,971 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:04,973 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,975 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,977 copying lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,979 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,981 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,983 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:04,985 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:04,988 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:04,990 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:04,992 copying lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:04,994 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:04,996 copying lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:04,998 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:05,001 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:05,003 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:05,005 copying lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:05,006 copying lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:05,009 copying lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:05,011 copying lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:05,013 copying lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,015 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,017 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,019 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,021 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,023 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,025 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:05,028 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,030 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,032 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,034 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,036 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,039 copying lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,041 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,043 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,045 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:05,047 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,050 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,052 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,054 copying lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,056 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,058 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,060 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,062 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:05,064 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:05,066 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:05,069 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:05,071 copying lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:05,073 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:05,075 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:05,077 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:05,079 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:05,081 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,084 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,086 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,088 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,090 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,092 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,094 copying lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:05,096 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:05,098 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:05,100 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:05,102 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:05,105 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,107 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,109 copying lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,111 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,113 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,115 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:05,117 copying lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:05,119 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:05,122 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:05,124 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:05,126 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,128 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,130 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,132 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,134 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,137 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,139 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,141 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,143 copying lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:05,145 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,147 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,150 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,152 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,154 copying lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,156 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:05,158 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,161 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,163 copying lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,166 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,168 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,171 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,173 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,175 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,177 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:05,179 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:05,181 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:05,183 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:05,186 copying lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:05,188 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,190 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,193 copying lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,195 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,197 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,200 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:05,202 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:05,205 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:05,207 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:05,210 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:05,212 copying lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:05,214 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,217 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,219 copying lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,221 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,223 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,225 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:05,227 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,230 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,232 copying lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,234 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,237 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,239 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,241 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:05,244 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:05,246 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:05,249 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:05,252 copying lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:05,255 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:05,257 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:05,259 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:05,261 copying lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:05,264 copying lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:05,266 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:05,268 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:05,270 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:05,272 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:05,274 copying lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:05,277 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:05,279 copying lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:05,281 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:05,284 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:05,286 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,288 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,290 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,293 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,295 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,297 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,300 copying lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:05,302 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:05,304 copying lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:05,306 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:05,308 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:05,310 copying lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:05,313 copying lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:05,315 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:05,317 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:05,319 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:05,322 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:05,324 copying lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:05,326 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:05,328 copying lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:05,331 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:05,333 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:05,335 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:05,337 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,340 copying lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,342 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,344 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,347 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,349 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:05,351 copying lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:05,353 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:05,356 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:05,358 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:05,360 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:05,362 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:05,364 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:05,366 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:05,369 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:05,371 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:05,373 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:05,375 copying lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:05,377 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,379 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,382 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,384 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,386 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,388 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,391 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:05,393 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:05,395 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:05,397 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:05,399 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:05,402 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:05,404 copying lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:05,406 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:05,408 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:05,411 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:05,412 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:05,415 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:05,416 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:05,419 copying lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:05,421 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:05,423 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:05,425 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:05,427 copying lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:05,429 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,432 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,434 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,436 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,439 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,441 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:05,443 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,446 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,448 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,451 copying lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,453 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,455 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:05,458 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:05,460 copying lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:05,462 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:05,464 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,467 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,469 copying lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,471 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,473 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,476 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:05,478 creating build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,479 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,481 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,484 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,486 copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,488 copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,490 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,492 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,494 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,496 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,499 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,501 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,503 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,506 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,508 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,510 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,512 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:05,515 copying lm_eval/tasks/careqa/careqa_es.yaml -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:43:05,517 copying lm_eval/tasks/careqa/careqa_en.yaml -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:43:05,519 copying lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:43:05,522 copying lm_eval/tasks/careqa/careqa_open.yaml -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:43:05,524 creating build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,525 copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,527 copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,529 copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,532 copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,534 copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,536 copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,538 copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,540 copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,542 copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,545 copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,547 copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,549 copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,551 copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,553 copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,555 copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,558 copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,560 copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,562 copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,564 copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,567 copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,569 copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,571 copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:05,573 copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:05,575 copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:05,578 copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:05,580 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:05,582 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:05,585 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:05,587 copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:05,589 copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:05,591 copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:05,594 copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:43:05,596 copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:43:05,598 copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:43:05,601 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:05,603 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:05,605 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:05,607 copying lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:43:05,610 copying lm_eval/tasks/mbpp/mbpp.yaml -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:43:05,612 copying lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:43:05,614 copying lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:43:05,616 creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,617 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,619 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,622 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,624 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,626 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,628 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,631 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:05,633 copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:43:05,635 copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:43:05,638 copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:43:05,640 copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts 2025-11-27T00:43:05,642 creating build/lib/lm_eval/tasks/triviaqa 2025-11-27T00:43:05,643 copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa 2025-11-27T00:43:05,646 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:05,648 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:05,651 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:05,653 copying lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,655 copying lm_eval/tasks/longbench/repobench-p_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,657 copying lm_eval/tasks/longbench/_longbench.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,660 copying lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,662 copying lm_eval/tasks/longbench/trec_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,664 copying lm_eval/tasks/longbench/multi_news_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,666 copying lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,669 copying lm_eval/tasks/longbench/lcc.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,671 copying lm_eval/tasks/longbench/dureader.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,673 copying lm_eval/tasks/longbench/lcc_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,676 copying lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,678 copying lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,680 copying lm_eval/tasks/longbench/gov_report.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,682 copying lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,684 copying lm_eval/tasks/longbench/_longbench_single.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,687 copying lm_eval/tasks/longbench/qasper.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,689 copying lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,691 copying lm_eval/tasks/longbench/vcsum.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,693 copying lm_eval/tasks/longbench/passage_count.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,695 copying lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,697 copying lm_eval/tasks/longbench/hotpotqa.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,699 copying lm_eval/tasks/longbench/narrativeqa.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,701 copying lm_eval/tasks/longbench/musique.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,703 copying lm_eval/tasks/longbench/gov_report_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,705 copying lm_eval/tasks/longbench/repobench-p.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,708 copying lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,710 copying lm_eval/tasks/longbench/trec.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,712 copying lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,714 copying lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,716 copying lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,718 copying lm_eval/tasks/longbench/passage_count_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,720 copying lm_eval/tasks/longbench/multi_news.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,722 copying lm_eval/tasks/longbench/lsht.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,724 copying lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,726 copying lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,729 copying lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,731 copying lm_eval/tasks/longbench/_longbench_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,733 copying lm_eval/tasks/longbench/samsum.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,735 copying lm_eval/tasks/longbench/2wikimqa.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,737 copying lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,739 copying lm_eval/tasks/longbench/_longbench_multi.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,741 copying lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,743 copying lm_eval/tasks/longbench/qmsum.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,745 copying lm_eval/tasks/longbench/samsum_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,747 copying lm_eval/tasks/longbench/qasper_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,750 copying lm_eval/tasks/longbench/triviaqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,752 copying lm_eval/tasks/longbench/_longbench_code.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,754 copying lm_eval/tasks/longbench/triviaqa.yaml -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:05,756 copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia 2025-11-27T00:43:05,758 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,760 copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,762 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,764 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,766 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,768 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,770 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,772 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,774 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,776 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,778 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,780 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,782 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,785 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,787 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,789 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,791 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,793 copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,795 copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,797 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,799 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,801 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,803 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,805 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,807 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,809 copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,811 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,814 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,816 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,818 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,820 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,822 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,824 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,826 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,828 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,830 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,832 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,834 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,836 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,838 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,840 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,842 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,844 copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,846 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,848 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,850 copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,852 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,854 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,856 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,858 copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,860 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,863 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,865 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,867 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,869 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,871 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,873 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,876 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,878 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,880 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,882 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,884 copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:05,887 copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2025-11-27T00:43:05,889 copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2025-11-27T00:43:05,891 copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2025-11-27T00:43:05,893 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,895 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,898 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,900 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,902 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,904 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,906 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,908 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,910 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,912 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,914 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,916 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,918 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,920 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,923 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,925 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,927 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:05,929 copying lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:43:05,932 copying lm_eval/tasks/graphwalks/graphwalks.yaml -> build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:43:05,934 copying lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:43:05,936 copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,939 copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,941 copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,943 copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,945 copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,948 copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,950 copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,952 copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,955 copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,957 copying lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:05,959 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,961 copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,963 copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,965 copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,968 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,970 copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,972 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,974 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,976 copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,979 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,981 copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,983 copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,985 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,988 copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,990 copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,993 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,995 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:05,997 creating build/lib/lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:05,998 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:06,001 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:06,003 copying lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:43:06,005 copying lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:43:06,007 copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual 2025-11-27T00:43:06,009 copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual 2025-11-27T00:43:06,011 copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,014 copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,016 copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,019 copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,021 copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,024 copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,026 copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,028 copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:06,030 copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,032 copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,034 copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,037 copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,039 copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,041 copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,043 copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,045 copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,047 copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,049 copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,051 copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,053 copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,055 copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,057 copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,059 copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,061 copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,063 copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,065 copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,068 copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,070 copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,072 copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,074 copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,076 copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,078 copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,080 copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,082 copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,084 copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,086 copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,088 copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,090 copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,093 copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,095 copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,097 copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,099 copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,101 copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,102 copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,104 copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,106 copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,108 copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,110 copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,112 copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,114 copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,116 copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,118 copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,120 copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,122 copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,124 copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,126 copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,128 copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,130 copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,132 copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,134 copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,136 copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,139 copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,141 copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,143 copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,145 copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,147 copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,149 copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,151 copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,153 copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,155 copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,157 copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,159 copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,161 copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,164 copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,166 copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,168 copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,170 copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,172 copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,174 copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,176 copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,178 copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,180 copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,182 copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,184 copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,186 copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,189 copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,191 copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,193 copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,195 copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,197 copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,199 copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,201 copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,203 copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,205 copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,208 copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,210 copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,212 copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,214 copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,216 copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,218 copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,220 copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,222 copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,224 copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,226 copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,229 copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,231 copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,233 copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,235 copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,237 copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,239 copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,242 copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,244 copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,246 copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,248 copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,250 copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,252 copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,254 copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,256 copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,258 copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,261 copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,263 copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,265 copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,267 copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,269 copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,271 copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,273 copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,275 copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,277 copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,279 copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,281 copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,283 copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:06,285 creating build/lib/lm_eval/tasks/afrimgsm/direct 2025-11-27T00:43:06,286 copying lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2025-11-27T00:43:06,289 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,290 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,292 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,294 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,297 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,299 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,301 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,303 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,305 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,307 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,310 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,312 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,314 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,316 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,318 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,321 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,323 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,325 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,327 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,329 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:06,331 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,332 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,335 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,337 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,339 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,341 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,344 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,346 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,348 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,350 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,352 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,354 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,357 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,359 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,361 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,364 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,367 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,369 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,372 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,374 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:06,376 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,377 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,379 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,381 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,383 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,385 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,388 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,390 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,392 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,394 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,396 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,399 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,401 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,403 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,406 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,409 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,412 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,414 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,416 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,418 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:06,420 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,421 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,423 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,425 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,428 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,430 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,432 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,434 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,437 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,439 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,441 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,444 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,446 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,449 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,451 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,455 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,457 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,459 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,461 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,463 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:06,465 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,466 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,469 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,471 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,473 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,475 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,478 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,480 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,482 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,485 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,487 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,489 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,491 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,494 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,496 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,499 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,501 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,504 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,506 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,508 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:06,510 creating build/lib/lm_eval/tasks/afrimgsm/translate 2025-11-27T00:43:06,511 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2025-11-27T00:43:06,514 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,515 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,517 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,519 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,521 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,523 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,525 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,528 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,530 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,532 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,534 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,537 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,539 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,541 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,543 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,546 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,548 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,550 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:06,552 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,553 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,555 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,558 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,560 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,562 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,565 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,567 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,569 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,571 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,573 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,576 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,578 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,580 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,582 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,584 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,587 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,589 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:06,591 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,592 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,594 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,597 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,599 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,601 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,603 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,606 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,608 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,610 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,612 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,615 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,617 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,619 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,622 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,624 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,626 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,628 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:06,630 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,631 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,634 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,636 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,638 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,640 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,643 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,645 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,647 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,649 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,652 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,654 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,656 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,659 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,661 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,663 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,665 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,668 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:06,670 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,671 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,674 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,676 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,678 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,681 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,683 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,685 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,688 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,690 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,692 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,694 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,697 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,699 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,701 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,703 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,705 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,708 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:06,710 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot 2025-11-27T00:43:06,711 copying lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot 2025-11-27T00:43:06,713 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,714 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,717 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,719 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,721 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,724 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,726 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,728 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,731 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,733 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,735 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,738 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,740 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,742 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,744 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,746 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,748 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,751 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,753 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:06,755 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,756 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,758 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,761 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,763 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,765 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,767 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,770 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,772 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,774 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,777 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,779 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,781 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,783 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,786 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,788 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,791 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,793 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,796 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:06,798 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,799 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,801 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,804 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,806 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,808 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,811 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,813 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,815 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,818 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,820 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,822 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,825 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,827 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,829 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,832 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,834 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,836 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,839 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:06,841 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,842 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,844 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,847 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,849 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,852 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,854 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,856 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,858 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,860 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,863 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,865 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,867 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,869 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,872 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,874 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,876 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,879 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,881 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:06,883 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,884 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,886 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,889 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,891 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,893 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,896 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,898 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,901 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,903 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,905 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,908 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,910 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,912 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,915 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,917 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,919 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,921 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,924 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:06,926 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot 2025-11-27T00:43:06,927 copying lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot 2025-11-27T00:43:06,929 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,930 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,933 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,935 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,937 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,940 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,942 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,944 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,947 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,949 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,951 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,953 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,956 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,958 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,960 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,963 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,965 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,967 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,969 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,971 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:06,974 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,975 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,977 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,979 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,982 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,984 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,986 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,989 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,991 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,993 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,995 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:06,998 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,000 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,002 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,004 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,007 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,009 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,011 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,014 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,016 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:07,018 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,019 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,022 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,024 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,026 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,028 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,031 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,033 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,035 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,037 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,039 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,041 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,043 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,045 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,047 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,050 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,052 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,054 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,056 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,058 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:07,060 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,061 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,063 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,065 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,067 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,069 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,071 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,073 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,076 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,078 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,080 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,082 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,084 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,086 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,089 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,091 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,093 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,095 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,097 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,099 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:07,102 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,103 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,105 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,107 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,109 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,112 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,114 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,116 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,118 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,121 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,123 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,125 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,127 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,130 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,132 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,134 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,137 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,139 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,141 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,143 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:07,145 copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag 2025-11-27T00:43:07,147 copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,150 copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,152 copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,154 copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,156 copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,158 copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,161 copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,163 copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,165 copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,167 copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,169 copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,172 copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,174 copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,176 copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,178 copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,180 copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,183 copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,185 copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,187 copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:07,189 copying lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/lib/lm_eval/tasks/med_text_classification 2025-11-27T00:43:07,191 copying lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/lib/lm_eval/tasks/med_text_classification 2025-11-27T00:43:07,194 creating build/lib/lm_eval/tasks/prost 2025-11-27T00:43:07,194 copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost 2025-11-27T00:43:07,197 copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa 2025-11-27T00:43:07,199 copying lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/lib/lm_eval/tasks/groundcocoa 2025-11-27T00:43:07,201 creating build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,202 copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,205 copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,207 copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,209 copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,211 copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,213 copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,216 copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,218 copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,220 copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,222 copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,224 copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,226 copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:07,228 creating build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,230 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,232 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,234 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,236 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,239 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,241 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,243 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,245 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,247 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,249 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,252 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,254 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,256 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,258 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,260 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,262 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,264 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,267 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,269 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,271 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,273 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,275 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,277 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,279 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,281 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,284 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,286 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,288 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,290 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,292 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,294 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,296 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,299 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,301 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,303 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,305 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,307 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,309 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,312 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,314 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,316 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,318 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,320 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,322 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,324 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,326 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,329 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,331 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,333 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,335 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:07,337 creating build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,338 copying lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,340 copying lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,342 copying lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,344 copying lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,347 copying lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,349 copying lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,351 copying lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,353 copying lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,356 copying lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,358 copying lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,360 copying lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,362 copying lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,364 copying lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,367 copying lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,369 copying lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,371 copying lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,373 copying lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,375 copying lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,377 copying lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,379 copying lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,381 copying lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,384 copying lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,386 copying lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,388 copying lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,390 copying lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,392 copying lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,395 copying lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,397 copying lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,399 copying lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,402 copying lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,404 copying lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,406 copying lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,408 copying lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,410 copying lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,412 copying lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,414 copying lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,417 copying lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,419 copying lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,421 copying lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,423 copying lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,425 copying lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,427 copying lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,429 copying lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,431 copying lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,433 copying lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,435 copying lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,437 copying lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,440 copying lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,442 copying lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,444 copying lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:07,446 creating build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,448 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,450 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,452 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,454 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,456 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,458 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,461 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,463 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,465 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,467 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,469 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,471 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,473 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,475 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,477 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,479 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,481 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,483 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,485 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,487 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,490 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,492 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,494 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,496 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,498 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,500 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,502 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,504 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,506 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,509 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,511 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,513 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,515 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,517 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,519 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,521 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,524 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,526 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,528 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,531 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,533 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,535 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,537 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,539 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,541 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,543 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,546 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,548 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,550 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,552 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:07,554 creating build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,555 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,558 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,562 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,565 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,568 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,571 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,574 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,577 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,579 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,582 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,585 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,588 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,591 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,594 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,597 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,601 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,604 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,609 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,612 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,615 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,618 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,622 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,625 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,627 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,630 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,633 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,636 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,639 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,642 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,646 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,649 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,653 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,656 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,659 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,662 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,665 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,668 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,672 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,675 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,677 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,681 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,684 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,687 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,690 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,693 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,695 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,699 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,708 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,713 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,715 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:07,718 creating build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,719 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,721 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,724 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,726 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,728 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,730 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,732 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,735 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,737 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,739 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,741 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,743 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,746 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,748 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,750 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,752 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,755 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,757 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,759 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,761 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,763 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,766 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,768 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,770 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,772 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,775 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,777 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,779 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,782 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,784 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,786 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,788 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,790 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,792 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,794 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,796 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,798 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,801 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,803 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,805 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,807 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,810 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,812 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,815 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,817 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,819 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,821 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,823 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,825 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,828 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:07,830 copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:43:07,832 copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:43:07,834 copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:43:07,836 copying lm_eval/tasks/c4/c4.yaml -> build/lib/lm_eval/tasks/c4 2025-11-27T00:43:07,839 creating build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,840 copying lm_eval/tasks/kormedmcqa/pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,842 copying lm_eval/tasks/kormedmcqa/dentist.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,845 copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,847 copying lm_eval/tasks/kormedmcqa/doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,849 copying lm_eval/tasks/kormedmcqa/nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:07,851 copying lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:07,853 copying lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:07,856 copying lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:07,858 copying lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:07,860 copying lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:07,862 creating build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,863 copying lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,865 copying lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,867 copying lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,870 copying lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,872 copying lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,874 copying lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:07,876 creating build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,877 copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,880 copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,882 copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,884 copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,886 copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,888 copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:07,891 copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop 2025-11-27T00:43:07,893 creating build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,894 copying lm_eval/tasks/bhs/bhs_basque.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,896 copying lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,898 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,900 copying lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,902 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,905 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,907 copying lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,909 copying lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,911 copying lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,913 copying lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,915 copying lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,918 copying lm_eval/tasks/bhs/bhs_hindi.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,920 copying lm_eval/tasks/bhs/bhs_swahili.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,922 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,924 copying lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,927 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,929 copying lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,931 copying lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,933 copying lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,935 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,937 copying lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,939 copying lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,941 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,943 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,946 copying lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:07,948 copying lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2025-11-27T00:43:07,950 copying lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2025-11-27T00:43:07,952 copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda 2025-11-27T00:43:07,954 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,957 copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,959 copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,961 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,963 copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,966 copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,968 copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,970 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,973 copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,975 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,977 copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,979 copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,981 copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,984 copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,986 copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,988 copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,991 copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,993 copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,995 copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:07,998 copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,000 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,002 copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,004 copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,007 copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,009 copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,011 copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,013 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,015 copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:08,017 creating build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,018 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,021 copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,023 copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,025 copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,028 copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,030 copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,032 copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,034 copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,037 copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,039 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,041 copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,043 copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,045 copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,047 copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,050 copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,052 copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,054 copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,057 copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,059 copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,061 copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,063 copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,066 copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,068 copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,070 copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,072 copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,075 copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,077 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,079 copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:08,082 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,084 copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,086 copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,088 copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,091 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,095 copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,098 copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,102 copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,104 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,107 copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,110 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,113 copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,116 copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,119 copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,122 copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,126 copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,129 copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,133 copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,135 copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,137 copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,140 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,142 copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,145 copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,148 copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,155 copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,165 copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,172 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,175 copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:08,179 creating build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,180 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,183 copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,187 copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,190 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,193 copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,196 copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,199 copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,203 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,206 copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,209 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,212 copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,215 copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,218 copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,220 copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,223 copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,225 copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,228 copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,230 copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,233 copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,236 copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,238 copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,240 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,243 copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,245 copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,248 copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,250 copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,253 copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,255 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,257 copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:08,259 copying lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,261 copying lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,263 copying lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,265 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,268 copying lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,270 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,272 copying lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,274 copying lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,277 copying lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,279 copying lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,281 copying lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,283 copying lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,286 copying lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,288 copying lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,290 copying lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,293 copying lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,295 copying lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,297 copying lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,299 copying lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,301 copying lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,304 copying lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,306 copying lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,308 copying lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,310 copying lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,313 copying lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,315 copying lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,317 copying lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,319 copying lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,321 copying lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,323 copying lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,326 copying lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,328 copying lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,330 copying lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,332 copying lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,335 copying lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,337 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,339 copying lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,341 copying lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,343 copying lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,345 copying lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,347 copying lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,349 copying lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,351 copying lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,353 copying lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,355 copying lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,358 copying lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,360 copying lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:08,362 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,364 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,366 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,368 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,370 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,372 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,375 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,377 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,379 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,381 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,383 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,385 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,388 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,390 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,392 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,394 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,396 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,399 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,401 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,403 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,405 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,407 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,410 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,412 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,414 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,416 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,418 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,420 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,422 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,424 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:08,427 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,429 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,431 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,433 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,435 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,437 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,440 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,442 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,444 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,446 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,448 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,451 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,453 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,455 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,457 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,460 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,462 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,464 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,467 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,474 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,475 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,475 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,476 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,478 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,480 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,482 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,484 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,486 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,488 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,490 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:08,492 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,495 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,497 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,499 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,501 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,503 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,505 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,507 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,509 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,511 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,513 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,515 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,517 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,520 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,522 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,524 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,526 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,528 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,531 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,533 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,535 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,537 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,539 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,541 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,543 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,546 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,548 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,550 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,552 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,554 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:08,556 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,558 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,560 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,562 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,564 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,566 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,568 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,571 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,573 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,575 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,577 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,579 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,581 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,583 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,585 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,587 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,590 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,592 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,594 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,596 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,598 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,600 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,602 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,604 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,607 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,609 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,611 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,613 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,615 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,617 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:08,619 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,621 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,623 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,625 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,627 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,629 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,631 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,633 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,635 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,637 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,640 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,642 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,644 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,646 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,648 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,651 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,653 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,655 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,657 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,659 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,661 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,663 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,666 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,668 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,670 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,672 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,674 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,676 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,679 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,681 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:08,683 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,684 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,686 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,688 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,690 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,692 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,694 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,696 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,698 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,700 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,702 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,704 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,707 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,709 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,711 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,713 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,715 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,717 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,720 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,722 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,724 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,726 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,729 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,731 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,733 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,735 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,737 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,739 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,741 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,744 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:08,746 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,748 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,750 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,752 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,754 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,756 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,758 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,760 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,762 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,764 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,766 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,769 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,771 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,773 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,775 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,777 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,779 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,781 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,784 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,786 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,788 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,790 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,792 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,794 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,796 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,798 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,801 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,803 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,805 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,807 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:08,809 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,811 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,813 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,815 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,817 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,819 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,821 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,823 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,825 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,827 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,829 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,831 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,833 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,836 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,838 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,840 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,842 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,844 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,846 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,848 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,850 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,852 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,854 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,856 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,859 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,861 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,863 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,865 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,867 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,869 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:08,871 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,873 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,875 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,878 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,880 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,882 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,884 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,886 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,888 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,890 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,892 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,893 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,895 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,897 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,899 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,901 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,903 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,905 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,907 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,910 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,912 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,914 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,916 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,918 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,920 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,922 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,924 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,926 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,928 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,931 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:08,933 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,936 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,939 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,941 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,944 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,946 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,949 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,951 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,954 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,956 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,959 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,961 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,963 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,966 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,969 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,971 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,974 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,976 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,979 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,981 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,984 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,987 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,989 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,992 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,995 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:08,997 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:09,000 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:09,002 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:09,005 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:09,008 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:09,010 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,013 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,016 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,018 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,021 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,024 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,026 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,029 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,031 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,033 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,035 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,037 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,039 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,041 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,043 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,045 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,047 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,049 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,051 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,053 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,055 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,057 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,060 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,062 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,064 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,066 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,068 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,070 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,072 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,074 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:09,076 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,079 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,081 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,083 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,085 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,087 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,089 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,091 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,093 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,096 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,098 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,100 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,102 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,104 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,106 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,108 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,110 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,112 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,114 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,116 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,118 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,120 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,122 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,124 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,126 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,128 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,131 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,133 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,135 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,137 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:09,139 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,141 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,143 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,145 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,147 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,150 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,152 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,154 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,156 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,158 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,160 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,162 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,164 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,166 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,168 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,170 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,172 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,175 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,177 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,179 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,181 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,183 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,185 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,187 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,189 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,191 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,193 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,195 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,197 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,199 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:09,201 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,204 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,206 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,208 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,210 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,212 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,214 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,216 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,218 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,220 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,223 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,225 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,227 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,229 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,231 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,233 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,235 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,237 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,239 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,241 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,243 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,245 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,247 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,249 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,251 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,253 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,256 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,258 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,260 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,262 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:09,264 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,266 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,268 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,270 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,273 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,275 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,277 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,279 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,281 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,283 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,285 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,288 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,290 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,292 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,294 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,296 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,298 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,300 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,302 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,304 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,306 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,308 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,310 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,312 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,314 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,316 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,318 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,320 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,322 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,324 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:09,326 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,328 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,331 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,333 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,335 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,337 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,339 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,341 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,343 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,345 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,347 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,350 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,352 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,354 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,356 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,358 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,360 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,362 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,364 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,365 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,367 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,370 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,372 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,374 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,376 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,378 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,380 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,382 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,384 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,386 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:09,388 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,390 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,393 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,395 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,397 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,399 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,401 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,403 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,406 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,408 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,410 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,412 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,414 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,416 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,419 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,421 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,423 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,425 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,427 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,429 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,431 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,433 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,435 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,437 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,439 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,442 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,444 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,446 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,448 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,450 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:09,453 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,455 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,457 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,459 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,461 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,463 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,466 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,468 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,470 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,472 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,474 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,476 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,478 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,480 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,483 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,485 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,487 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,489 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,491 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,493 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,495 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,497 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,499 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,501 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,503 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,505 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,507 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,509 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,511 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,514 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:09,516 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,518 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,520 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,522 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,524 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,527 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,529 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,531 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,533 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,535 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,537 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,540 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,542 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,544 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,547 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,549 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,551 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,553 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,555 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,557 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,560 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,562 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,564 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,566 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,568 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,570 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,572 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,574 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,576 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,578 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:09,580 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,583 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,585 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,587 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,589 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,591 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,594 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,596 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,598 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,600 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,602 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,604 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,606 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,609 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,611 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,613 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,615 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,617 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,620 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,622 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,624 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,626 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,628 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,630 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,632 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,634 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,636 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,638 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,640 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,642 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:09,644 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,646 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,648 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,650 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,652 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,655 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,657 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,659 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,661 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,663 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,665 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,667 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,669 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,671 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,673 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,675 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,677 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,679 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,681 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,683 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,686 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,688 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,690 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,692 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,694 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,696 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,698 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,700 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,702 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,704 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:09,706 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,708 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,710 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,713 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,715 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,717 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,719 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,721 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,723 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,725 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,727 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,729 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,731 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,733 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,735 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,738 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,740 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,742 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,744 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,746 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,748 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,750 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,753 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,755 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,756 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,759 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,761 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,763 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,765 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,766 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:09,768 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,770 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,772 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,774 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,776 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,779 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,781 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,783 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,785 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,787 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,789 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,791 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,793 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,795 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,797 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,799 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,802 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,804 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,806 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,808 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,810 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,812 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,814 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,817 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,819 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,821 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,823 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,825 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,827 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,829 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:09,831 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,833 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,835 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,837 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,839 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,841 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,843 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,845 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,847 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,850 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,852 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,854 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,856 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,858 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,860 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,862 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,864 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,866 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,869 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,871 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,873 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,875 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,877 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,879 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,881 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,883 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,885 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,887 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,889 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,891 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:09,893 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,896 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,898 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,900 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,902 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,904 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,906 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,908 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,910 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,913 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,915 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,917 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,919 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,921 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,923 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,925 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,927 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,929 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,931 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,934 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,936 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,938 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,940 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,942 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,945 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,947 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,949 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,951 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,953 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,955 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:09,957 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,959 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,962 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,964 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,966 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,968 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,970 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,972 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,974 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,976 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,978 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,981 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,983 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,985 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,987 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,989 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,991 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,994 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,996 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:09,998 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,000 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,002 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,005 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,007 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,009 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,011 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,014 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,016 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,018 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,020 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:10,022 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,024 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,026 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,028 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,030 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,032 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,034 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,036 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,038 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,040 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,042 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,045 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,047 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,049 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,051 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,053 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,055 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,057 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,060 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,062 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,064 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,066 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,068 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,070 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,072 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,074 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,076 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,079 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,081 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,083 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:10,085 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,087 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,089 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,091 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,093 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,095 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,097 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,099 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,101 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,103 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,105 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,107 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,109 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,111 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,113 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,115 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,117 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,120 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,122 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,124 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,126 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,128 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,130 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,132 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,134 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,136 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,138 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,140 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,143 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,145 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:10,147 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,149 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,151 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,153 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,155 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,158 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,162 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,164 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,166 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,168 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,170 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,172 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,174 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,176 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,178 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,180 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,182 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,185 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,187 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,189 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,191 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,193 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,195 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,197 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,199 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,201 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,203 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,206 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,208 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,210 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:10,212 creating build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,213 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,215 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,218 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,220 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,222 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,224 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,226 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,228 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,230 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,232 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,234 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,236 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,238 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,240 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,242 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,244 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,246 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,248 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,251 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,252 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,255 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,257 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,259 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,261 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,263 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,266 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,268 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,270 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,272 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,274 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,276 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,278 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,280 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,283 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,285 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,287 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,289 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,291 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,293 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,295 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,297 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,299 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,301 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,304 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,306 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,309 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,312 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,317 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,324 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,331 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,333 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,336 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,338 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,341 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,347 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,353 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,359 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,362 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,364 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,367 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,371 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,376 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,381 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,386 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,389 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,392 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,394 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,396 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,398 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,400 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,402 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,404 copying lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,407 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:10,409 copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,411 copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,414 copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,416 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,418 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,420 copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,422 copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,424 copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,426 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,428 copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,430 copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,432 copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,435 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,437 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,439 copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,441 copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,443 copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,445 copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,447 copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,449 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,451 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,454 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,456 copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,458 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,460 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,462 copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,464 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,466 copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,468 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,471 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,473 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,475 copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,477 copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,479 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,481 copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,483 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,485 copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,487 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,489 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,491 copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,493 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,496 copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,498 copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,500 copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,502 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,504 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,507 copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,509 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,511 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,513 copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,515 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,517 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,519 copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,521 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,524 copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,526 copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,528 copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,530 copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,532 copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,534 copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,536 copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,538 copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,541 copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,543 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,545 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,547 copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,549 copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,551 copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,553 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,556 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,558 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,560 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,562 copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,565 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,567 copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,569 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,571 copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,573 copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,575 copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,577 copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,579 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,581 copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,583 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,585 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,587 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,589 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,591 copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,593 copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,595 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,597 copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,599 copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,601 copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,604 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,606 copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,608 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,610 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,612 copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,614 copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,616 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,618 copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,621 copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,623 copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,624 copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,626 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,629 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,631 copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,633 copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,635 copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,637 copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,639 copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,641 copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,643 copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,645 copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,647 copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,649 copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,651 copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,653 copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,656 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,658 copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,660 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,662 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,664 copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,667 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,669 copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,671 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,673 copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,675 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,677 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,679 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,681 copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,683 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,685 copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,687 copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,689 copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,691 copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:10,693 creating build/lib/lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:10,694 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:10,697 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:10,699 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:10,701 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,703 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,705 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,707 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,710 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,712 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,714 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,716 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,718 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,720 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,722 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,724 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,726 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,729 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,731 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,732 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,735 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,737 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,739 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,741 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,743 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,745 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,747 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,749 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,751 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,754 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,756 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,758 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,760 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,762 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,764 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,766 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,769 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,771 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,772 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,775 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,777 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,780 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,783 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,785 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,788 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,791 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,794 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,796 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,798 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,800 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,802 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,804 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,806 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:10,809 copying lm_eval/tasks/ruler/niah_single_1.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,811 copying lm_eval/tasks/ruler/cwe.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,813 copying lm_eval/tasks/ruler/niah_single_2.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,815 copying lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,817 copying lm_eval/tasks/ruler/ruler.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,819 copying lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,821 copying lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,823 copying lm_eval/tasks/ruler/qa_squad.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,825 copying lm_eval/tasks/ruler/niah_multiquery.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,827 copying lm_eval/tasks/ruler/fwe.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,829 copying lm_eval/tasks/ruler/vt.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,831 copying lm_eval/tasks/ruler/qa_hotpot.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,833 copying lm_eval/tasks/ruler/niah_multivalue.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,835 copying lm_eval/tasks/ruler/niah_single_3.yaml -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:10,837 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2025-11-27T00:43:10,839 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:10,841 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:10,843 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:10,845 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:10,848 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:10,850 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:10,852 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:10,854 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:10,856 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:10,858 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:10,860 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:10,862 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:10,864 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,867 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,869 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,871 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,873 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,875 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,877 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,879 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,881 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,884 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:10,886 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:10,888 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:10,890 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:10,892 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:10,894 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:10,896 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:10,898 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,901 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,903 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,905 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,907 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,909 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,911 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,913 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,915 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,917 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,919 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,921 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,923 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,925 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,927 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,929 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,932 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,934 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,936 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,938 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,940 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,942 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,944 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,946 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,948 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,950 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,953 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,955 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,957 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,959 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,961 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,963 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,965 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,967 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,970 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,972 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,974 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,976 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,978 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,981 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,983 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,985 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,987 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,989 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,991 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,993 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,995 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,997 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:10,999 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,002 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,004 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,006 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,008 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,010 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,012 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,014 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,016 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,018 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,020 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:11,022 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:11,024 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:11,026 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,029 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,031 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,033 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,035 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,037 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,039 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,041 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,043 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,045 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,047 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,049 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,051 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,053 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,056 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,058 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,060 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,062 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,064 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,066 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,068 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,070 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,072 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,074 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,076 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,078 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,080 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,082 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,084 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,086 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,089 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,091 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,093 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,095 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,097 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,099 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,101 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,103 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,105 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,107 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,109 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,111 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,113 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,115 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,117 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,120 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,122 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,125 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,127 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,129 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,131 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,133 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,135 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,137 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,139 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,141 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,143 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,146 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:11,149 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:11,151 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:11,154 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:11,156 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:11,159 creating build/lib/lm_eval/tasks/mc_taco 2025-11-27T00:43:11,161 copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco 2025-11-27T00:43:11,163 copying lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:11,166 copying lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,168 copying lm_eval/tasks/winogender/winogender_male.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,171 copying lm_eval/tasks/winogender/winogender.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,173 copying lm_eval/tasks/winogender/winogender_female.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,176 copying lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,178 copying lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,181 copying lm_eval/tasks/winogender/winogender_neutral.yaml -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:11,183 copying lm_eval/tasks/olaph/olaph.yaml -> build/lib/lm_eval/tasks/olaph 2025-11-27T00:43:11,186 copying lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/lib/lm_eval/tasks/olaph 2025-11-27T00:43:11,188 copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score 2025-11-27T00:43:11,191 copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:11,193 copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:11,196 copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:11,198 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,201 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,204 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,207 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,209 copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,212 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,215 copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,218 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,220 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,223 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,225 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,228 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,231 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,233 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,236 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,239 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,241 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,244 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,246 copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,248 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,250 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,252 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,254 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,256 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,258 copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:11,260 copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,262 copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,264 copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,266 copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,268 copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,270 copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,272 copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,274 copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,276 copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,279 copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,281 copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,283 copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,285 copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,287 copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,289 copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,291 copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,293 copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:11,295 creating build/lib/lm_eval/tasks/lambada_cloze 2025-11-27T00:43:11,296 copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2025-11-27T00:43:11,298 copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2025-11-27T00:43:11,300 copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,302 copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,304 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,306 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,308 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,310 copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,312 copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,314 copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,316 copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,318 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,320 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,322 copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,324 copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,326 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,328 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,330 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,332 copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,334 copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,336 copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,338 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,340 copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,342 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,344 copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,346 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,348 copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,351 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,353 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,355 copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,357 copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,359 copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,361 copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,363 copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,365 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,367 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,369 copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,371 copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,373 copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,375 copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,377 copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,379 copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,381 copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,383 copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,385 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,387 copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,389 copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,391 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,393 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,395 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,398 copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,400 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,402 copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,404 copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,406 copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,408 copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,410 copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,412 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,414 copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,416 copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,418 copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,420 copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,422 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,424 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,426 copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,428 copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,430 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,432 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,434 copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,436 copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,438 copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,440 copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,442 copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,444 copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:11,446 copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:43:11,448 creating build/lib/lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:11,449 copying lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:11,451 creating build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,452 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,454 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,456 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,458 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,460 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,462 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,465 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,466 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,469 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,471 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,473 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,475 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,477 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,479 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,481 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,483 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,485 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,487 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,489 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,491 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,493 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,495 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,497 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,499 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,501 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,503 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,505 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,507 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,509 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,511 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,513 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,515 copying lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,517 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,519 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,521 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,524 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,526 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,528 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,530 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,532 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,534 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,536 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,538 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,540 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,542 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,544 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,546 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,548 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,550 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,552 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,554 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,556 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,558 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,561 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,563 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,565 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,567 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,569 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:11,571 creating build/lib/lm_eval/tasks/arc 2025-11-27T00:43:11,572 copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc 2025-11-27T00:43:11,574 copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc 2025-11-27T00:43:11,576 copying lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/lib/lm_eval/tasks/arc 2025-11-27T00:43:11,578 copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion 2025-11-27T00:43:11,580 creating build/lib/lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:11,582 copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:11,584 creating build/lib/lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:11,585 copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:11,587 copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:43:11,589 copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:43:11,591 copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:43:11,593 copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,595 copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,597 copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,599 copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,601 copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,603 copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,605 copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,607 copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,609 copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,611 copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,613 copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,615 copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,617 copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,620 copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,622 copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,625 copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:11,627 creating build/lib/lm_eval/tasks/headqa 2025-11-27T00:43:11,628 copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa 2025-11-27T00:43:11,631 copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa 2025-11-27T00:43:11,633 creating build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,634 copying lm_eval/tasks/turblimp/binding.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,636 copying lm_eval/tasks/turblimp/irregular_forms.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,638 copying lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,640 copying lm_eval/tasks/turblimp/ellipsis.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,643 copying lm_eval/tasks/turblimp/quantifiers.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,645 copying lm_eval/tasks/turblimp/subject_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,647 copying lm_eval/tasks/turblimp/nominalization.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,649 copying lm_eval/tasks/turblimp/relative_clauses.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,651 copying lm_eval/tasks/turblimp/passives.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,654 copying lm_eval/tasks/turblimp/scrambling.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,656 copying lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,658 copying lm_eval/tasks/turblimp/determiners.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,660 copying lm_eval/tasks/turblimp/npi_licensing.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,662 copying lm_eval/tasks/turblimp/turblimp_group.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,664 copying lm_eval/tasks/turblimp/island_effects.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,667 copying lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,669 copying lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:11,671 copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext 2025-11-27T00:43:11,672 creating build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,673 copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,676 copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,678 copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,680 copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,682 copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,683 copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:11,687 copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,689 copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,691 copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,693 copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,695 copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,697 copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:11,699 creating build/lib/lm_eval/tasks/siqa 2025-11-27T00:43:11,700 copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa 2025-11-27T00:43:11,702 copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,704 copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,707 copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,709 copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,711 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,713 copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,715 copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,717 copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,719 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,721 copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,723 copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,725 copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,728 copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:11,730 copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,732 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,734 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,736 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,738 copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,740 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,742 copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,744 copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,746 copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,748 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,750 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,752 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,754 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,756 copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,758 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,760 copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,762 copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:11,765 copying lm_eval/tasks/click/click.yaml -> build/lib/lm_eval/tasks/click 2025-11-27T00:43:11,767 copying lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:43:11,769 copying lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:43:11,771 copying lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:43:11,773 copying lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:43:11,775 copying lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,777 copying lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,779 copying lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,781 copying lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,783 copying lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,785 copying lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,787 copying lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,789 copying lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,791 copying lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:11,793 creating build/lib/lm_eval/tasks/sciq 2025-11-27T00:43:11,794 copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq 2025-11-27T00:43:11,796 copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen 2025-11-27T00:43:11,799 copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2 2025-11-27T00:43:11,800 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:11,802 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:11,804 copying lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,806 copying lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,808 copying lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,810 copying lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,813 copying lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,815 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,817 copying lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,819 copying lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,821 copying lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,823 copying lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,825 copying lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,827 copying lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,829 copying lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,831 copying lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,833 copying lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,836 copying lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,838 copying lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,840 copying lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,842 copying lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,844 copying lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,846 copying lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,848 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,850 copying lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,852 copying lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,854 copying lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,856 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,859 copying lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,861 copying lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,863 copying lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,865 copying lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,867 copying lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,869 copying lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,871 copying lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,873 copying lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,875 copying lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,877 copying lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,879 copying lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,881 copying lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,883 copying lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,885 copying lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,887 copying lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,889 copying lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,891 copying lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,893 copying lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,895 copying lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,897 copying lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,899 copying lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:11,901 copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,903 copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,905 copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,907 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,909 copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,911 copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,914 copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,916 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:11,918 creating build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,919 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,921 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,923 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,925 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,927 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,929 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,931 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,933 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,935 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,937 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,940 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:11,942 creating build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,943 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,945 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,947 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,949 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,951 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,953 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,955 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,957 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,959 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,961 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,963 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:11,965 creating build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,966 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,969 copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,971 copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,973 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,975 copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,977 copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,979 copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,981 copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,983 copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,985 copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,987 copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:11,990 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2025-11-27T00:43:11,992 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:11,994 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:11,996 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:11,998 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,000 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,002 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,005 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,007 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,009 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,011 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,013 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,015 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,017 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,019 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,021 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,024 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,026 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,028 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,030 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,032 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,034 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,036 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,038 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,041 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,042 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,045 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,047 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,049 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,051 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,053 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,055 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,057 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,059 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,062 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,064 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,066 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,068 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,070 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,072 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,074 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,076 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,078 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,081 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,083 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,085 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,087 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,089 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,091 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,093 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,096 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,098 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,100 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,102 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,104 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,106 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,108 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,110 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,112 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,114 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:12,116 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:12,118 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:12,121 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:12,123 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:12,125 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:12,127 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:12,129 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:12,131 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:12,133 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:12,135 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:12,138 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:12,140 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:12,142 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:12,144 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:12,146 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:12,148 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:12,150 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:12,152 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:12,154 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,156 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,158 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,161 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,163 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,165 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,167 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,169 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,171 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,173 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,175 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,177 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,180 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,181 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,183 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,186 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,188 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,190 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,192 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,194 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,196 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,198 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,200 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,202 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,205 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,207 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,209 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,211 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,213 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,215 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,217 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,219 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,221 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,223 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,226 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,228 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,230 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,232 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,234 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,236 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,238 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,240 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,243 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,245 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,247 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,249 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,251 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,253 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,255 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,257 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,259 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,261 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,263 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,265 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,267 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,269 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,271 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,273 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:12,276 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:12,278 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:12,280 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:12,282 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:12,284 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:12,286 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:12,288 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,290 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,292 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,294 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,296 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,298 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,301 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,303 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,305 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,307 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:12,309 creating build/lib/lm_eval/tasks/asdiv 2025-11-27T00:43:12,310 copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv 2025-11-27T00:43:12,312 copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv 2025-11-27T00:43:12,314 creating build/lib/lm_eval/tasks/piqa 2025-11-27T00:43:12,315 copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa 2025-11-27T00:43:12,317 creating build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,318 copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,320 copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,322 copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,324 copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,326 copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,328 copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,330 copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,332 copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,334 copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,336 copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:12,338 copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id 2025-11-27T00:43:12,340 copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id 2025-11-27T00:43:12,342 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,344 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,346 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,348 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,350 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,352 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,354 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,357 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,359 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,361 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,363 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,365 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,367 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,369 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,371 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,373 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,375 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,377 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:12,380 copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,381 copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,383 copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,385 copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,387 copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,389 copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,391 copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,393 copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,395 copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,397 copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,399 copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,401 copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,403 copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,405 copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,407 copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,409 copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:12,411 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:12,414 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:12,416 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:12,418 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:12,420 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:12,422 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:12,424 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:12,426 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:12,428 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:12,430 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:12,432 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,433 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,436 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,437 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,439 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,441 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:12,443 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,444 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,446 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,449 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,451 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,453 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:12,455 creating build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2025-11-27T00:43:12,456 copying lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2025-11-27T00:43:12,458 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:12,460 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:12,462 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:12,464 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:12,466 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:12,468 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:12,470 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:12,472 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:12,474 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:12,476 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:12,479 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:12,481 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:12,483 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:12,485 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:12,487 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:12,489 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:12,490 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:12,492 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:12,494 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:12,496 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:12,498 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:12,499 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:12,501 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:12,503 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:12,505 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:12,507 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:12,508 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:12,512 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:12,514 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:12,516 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:12,518 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:12,519 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:12,521 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:12,523 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:12,525 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:12,527 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,528 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,530 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,532 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,535 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,537 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:12,539 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,540 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,542 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,544 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,546 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,548 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:12,550 creating build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,551 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,553 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,555 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,557 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,559 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:12,561 creating build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,562 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,564 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,566 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,568 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,570 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:12,572 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,573 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,575 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,578 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,580 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,582 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:12,584 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,585 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,587 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,589 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,591 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,593 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:12,595 creating build/lib/lm_eval/tasks/noreval/ncb 2025-11-27T00:43:12,596 copying lm_eval/tasks/noreval/ncb/ncb.yaml -> build/lib/lm_eval/tasks/noreval/ncb 2025-11-27T00:43:12,598 creating build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,599 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,601 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,603 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,605 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,607 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:12,609 creating build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,610 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,612 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,614 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,616 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,618 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:12,620 creating build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,621 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,623 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,625 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,627 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,629 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,632 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:12,634 creating build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,635 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,637 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,639 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,641 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,643 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,645 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:12,647 creating build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,648 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,651 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,653 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,655 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,657 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:12,659 copying lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:12,661 copying lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:12,663 copying lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:12,665 copying lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:12,667 copying lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:12,669 creating build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2025-11-27T00:43:12,670 copying lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2025-11-27T00:43:12,672 copying lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/lib/lm_eval/tasks/medtext 2025-11-27T00:43:12,674 copying lm_eval/tasks/medtext/medtext.yaml -> build/lib/lm_eval/tasks/medtext 2025-11-27T00:43:12,676 creating build/lib/lm_eval/tasks/polemo2 2025-11-27T00:43:12,677 copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2 2025-11-27T00:43:12,679 copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2 2025-11-27T00:43:12,681 copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading 2025-11-27T00:43:12,683 copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:12,685 copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:12,687 copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2025-11-27T00:43:12,690 copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2025-11-27T00:43:12,692 creating build/lib/lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:12,693 copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:12,695 copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:12,697 copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:12,699 copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2025-11-27T00:43:12,701 copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2025-11-27T00:43:12,703 copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record 2025-11-27T00:43:12,705 copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record 2025-11-27T00:43:12,707 creating build/lib/lm_eval/tasks/super_glue/wic 2025-11-27T00:43:12,708 copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2025-11-27T00:43:12,711 copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2025-11-27T00:43:12,713 copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:12,715 copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:12,717 creating build/lib/lm_eval/tasks/super_glue/rte 2025-11-27T00:43:12,718 copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2025-11-27T00:43:12,720 copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2025-11-27T00:43:12,722 copying lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,724 copying lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,726 copying lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,728 copying lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,730 copying lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,732 copying lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,734 copying lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,736 copying lm_eval/tasks/esbbq/esbbq_age.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,738 copying lm_eval/tasks/esbbq/esbbq.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,740 copying lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,742 copying lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:12,744 creating build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,746 copying lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,748 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,750 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,752 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,754 copying lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,756 copying lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,758 copying lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,760 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,763 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,765 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,767 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,769 copying lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,771 copying lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,773 copying lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,775 copying lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,777 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,779 copying lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,781 copying lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,783 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,785 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,787 copying lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,789 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,791 copying lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,793 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,795 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,797 copying lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,799 copying lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,801 copying lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,803 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,805 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,807 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,809 copying lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,812 copying lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,814 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,816 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,818 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,820 copying lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,822 copying lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,824 copying lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,826 copying lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,828 copying lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,831 copying lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,833 copying lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,835 copying lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,837 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,839 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,841 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,843 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,845 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,847 copying lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,849 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,851 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,853 copying lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,855 copying lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,858 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,860 copying lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,862 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,864 copying lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:12,866 copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,868 copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,870 copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,872 copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,875 copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,877 copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,879 copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,881 copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,883 copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,885 copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,887 copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,889 copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,891 copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,893 copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,895 copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,897 copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:12,899 copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,902 copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,904 copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,906 copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,908 copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,910 copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,912 copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,914 copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,916 copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,918 copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,920 copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,922 copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,924 copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,925 copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,927 copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,929 copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,931 copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,933 copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,935 copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,937 copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,939 copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,941 copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:12,943 copying lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,946 copying lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,948 copying lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,950 copying lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,953 copying lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,955 copying lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,957 copying lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,960 copying lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:12,962 creating build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,963 copying lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,965 copying lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,968 copying lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,970 copying lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,972 copying lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,974 copying lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,977 copying lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:12,979 creating build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,980 copying lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,982 copying lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,984 copying lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,986 copying lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,988 copying lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,990 copying lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,993 copying lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:12,995 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:12,997 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,000 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,003 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,005 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,008 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,010 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,013 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:13,016 copying lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2025-11-27T00:43:13,018 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,020 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,023 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,025 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,027 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,029 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,031 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,033 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,036 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,038 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,040 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,042 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,044 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,046 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,048 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,050 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,052 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,054 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:13,056 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,058 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,060 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,062 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,064 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,066 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,068 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,070 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,072 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,074 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,076 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,079 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,081 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,083 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,085 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,087 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,089 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,092 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:13,094 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,096 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,098 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,100 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,102 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,104 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,106 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,108 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,110 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,112 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,115 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,117 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,119 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,121 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,123 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,125 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,127 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,129 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:13,131 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,133 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,135 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,137 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,140 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,142 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,145 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,147 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,149 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,151 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,153 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,155 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,157 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,159 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,161 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,163 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,165 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,167 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:13,170 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,171 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,173 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,176 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,178 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,180 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,182 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,184 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,186 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,188 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,190 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,192 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,194 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,196 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,199 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,201 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,203 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,205 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:13,207 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2025-11-27T00:43:13,209 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,212 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,214 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,216 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,218 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,220 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,222 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,224 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,226 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,228 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,230 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,232 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,234 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,236 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,238 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,240 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,242 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:13,245 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,247 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,249 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,251 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,253 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,255 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,257 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,259 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,261 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,264 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,266 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,268 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,270 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,272 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,274 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,276 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,278 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:13,280 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,282 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,284 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,286 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,288 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,290 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,292 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,294 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,297 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,299 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,301 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,303 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,305 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,307 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,309 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,312 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,314 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:13,316 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,319 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,322 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,324 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,326 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,328 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,330 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,332 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,334 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,336 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,338 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,341 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,344 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,346 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,348 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,351 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,353 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:13,355 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,357 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,359 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,361 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,363 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,365 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,367 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,369 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,371 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,373 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,375 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,377 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,379 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,382 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,384 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,386 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,388 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:13,390 copying lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2025-11-27T00:43:13,392 copying lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2025-11-27T00:43:13,394 copying lm_eval/tasks/icelandic_winogrande/default.yaml -> build/lib/lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:13,396 creating build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:13,397 copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:13,400 copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:13,402 copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:13,405 copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273 2025-11-27T00:43:13,407 copying lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:43:13,410 copying lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:43:13,419 copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,427 copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,429 copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,431 copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,433 copying lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,435 copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,437 copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:13,440 copying lm_eval/tasks/aradice/aradice.yaml -> build/lib/lm_eval/tasks/aradice 2025-11-27T00:43:13,442 copying lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:13,444 copying lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:13,446 copying lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:13,448 copying lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:13,450 copying lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,452 copying lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,454 copying lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,456 copying lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,458 copying lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,460 copying lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:13,462 copying lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:43:13,464 copying lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:43:13,466 copying lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:43:13,469 copying lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:43:13,471 copying lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:43:13,473 copying lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:43:13,475 copying lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:43:13,477 copying lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2025-11-27T00:43:13,479 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:13,481 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:13,483 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:13,485 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:13,488 copying lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:13,490 copying lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:13,492 copying lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:13,494 copying lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:13,496 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,499 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,501 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,503 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,505 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,507 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,510 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,512 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,514 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,516 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,518 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,520 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,523 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,525 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,527 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,530 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,532 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,534 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,536 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,538 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,541 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,543 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,545 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,547 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,549 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,552 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,554 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,556 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,558 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,561 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,563 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,565 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,567 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,570 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,572 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,574 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,576 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,578 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,580 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,582 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,584 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:13,586 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,588 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,590 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,592 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,594 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,597 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,599 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,601 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,603 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,605 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,608 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,610 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,612 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,614 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,616 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,619 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,621 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,623 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,625 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,627 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,629 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,631 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,633 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,635 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,638 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,640 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,642 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,644 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,646 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,648 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,650 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,653 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,655 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,657 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,659 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,662 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,664 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,666 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,668 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,670 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,672 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:13,674 creating build/lib/lm_eval/tasks/eus_proficiency 2025-11-27T00:43:13,675 copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency 2025-11-27T00:43:13,677 creating build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,679 copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,681 copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,683 copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,685 copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,687 copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,689 copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,691 copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,693 copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,695 copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:13,697 creating build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,698 copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,701 copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,703 copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,706 copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,709 copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,711 copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,714 copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,717 copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,720 copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:13,722 creating build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,723 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,725 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,728 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,730 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,732 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:13,734 copying lm_eval/tasks/aime/aime.yaml -> build/lib/lm_eval/tasks/aime 2025-11-27T00:43:13,737 copying lm_eval/tasks/aime/aime24.yaml -> build/lib/lm_eval/tasks/aime 2025-11-27T00:43:13,739 copying lm_eval/tasks/aime/aime25.yaml -> build/lib/lm_eval/tasks/aime 2025-11-27T00:43:13,741 copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,743 copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,745 copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,747 copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,749 copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,751 copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,753 copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:13,755 creating build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,756 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,759 copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,761 copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,763 copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,765 copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,767 copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,769 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:13,771 creating build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:13,772 copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:13,774 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:13,776 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:13,779 copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:13,781 creating build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,782 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,784 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,787 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,789 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,791 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,793 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,795 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,797 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,799 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,802 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,804 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,805 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,808 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,810 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:13,811 creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,812 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,814 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,817 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,818 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,820 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,823 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,824 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,827 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,829 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,831 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,833 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,835 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,837 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:13,839 creating build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,840 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,842 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,844 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,846 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,849 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,851 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,853 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,855 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,857 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,859 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,861 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,863 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,865 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:13,867 creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,868 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,871 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,873 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,875 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,877 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,879 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,881 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,883 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,886 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,888 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,890 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,892 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,894 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,896 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:13,899 copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper 2025-11-27T00:43:13,901 copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper 2025-11-27T00:43:13,903 copying lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,905 copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,907 copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,909 copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,911 copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,914 copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,916 copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,918 copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,920 copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,922 copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,924 copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,926 copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,928 copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,930 copying lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,932 copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,934 copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,936 copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,938 copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,940 copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,942 copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,945 copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,947 copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,949 copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:13,951 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,953 copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,955 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,957 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,960 copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,962 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,964 copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,966 copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,968 copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,970 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,973 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,975 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,977 copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,979 copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,981 copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,984 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,986 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:13,987 creating build/lib/lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:13,989 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:13,991 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:13,993 copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard 2025-11-27T00:43:13,995 copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:43:13,997 copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:14,000 copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:14,002 copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:14,005 copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:14,007 creating build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,009 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,011 copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,014 copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,017 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,019 copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,021 copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,023 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,025 copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,027 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,030 copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,032 copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,034 copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,036 copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,038 copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,041 copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,043 copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,045 copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,047 copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,050 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,052 copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,054 copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,057 copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,059 copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,061 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,063 copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:14,065 copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:14,068 copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:14,070 copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:14,072 copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:14,074 copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:14,076 copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:14,078 copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,080 copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,082 copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,085 copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,087 copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,089 copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,091 copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,093 copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:14,095 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,097 copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,099 copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,102 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,104 copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,106 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,108 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,111 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,113 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,115 copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,117 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,119 copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,121 copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,123 copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,126 copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,128 copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,130 copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,132 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,134 copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,137 copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,139 copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,141 copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,143 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,145 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,148 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,150 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,152 copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,154 copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,156 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,159 copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,161 copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,163 copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,165 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,168 copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,170 copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,172 copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,175 copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,177 copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,179 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,181 copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,183 copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,185 copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,187 copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,189 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,192 copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,194 copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,196 copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,198 copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,200 copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,202 copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,204 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,206 copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,208 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,210 copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,213 copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,215 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,217 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,219 copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:14,221 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,224 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,226 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,228 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,231 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,233 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,235 copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,237 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,239 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,241 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,243 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,246 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,248 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,250 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,252 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,254 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,256 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,259 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,261 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,263 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,265 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,267 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,269 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,271 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,273 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,275 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,277 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,280 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,282 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,284 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,286 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,288 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,290 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,292 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,294 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,297 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,300 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,302 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,304 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,307 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,310 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,312 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,314 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,316 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,319 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,321 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,323 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,325 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,327 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,329 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,331 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,334 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,336 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,338 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,340 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,342 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,344 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,346 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:14,348 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,350 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,352 copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,354 copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,356 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,358 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,361 copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,363 copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,365 copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,367 copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,369 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,371 copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,373 copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,375 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,377 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,379 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,381 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,383 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,385 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,387 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,389 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,391 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,393 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,395 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,397 copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,400 copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,401 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,404 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,406 copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,409 copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,411 copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,413 copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,415 copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,418 copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,420 copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,422 copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,425 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,427 copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,429 copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,431 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,433 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,435 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,437 copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,439 copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,441 copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,443 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,445 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,448 copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,450 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,452 copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,453 copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,455 copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,458 copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,460 copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,462 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,464 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,466 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,468 copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:14,470 creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,471 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,474 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,476 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,478 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,481 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,483 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,485 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,487 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,490 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,492 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,494 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,497 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,499 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,501 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,504 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,506 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,509 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,511 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,514 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,516 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,518 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,521 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,524 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,526 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,528 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,531 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,533 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,535 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,538 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,540 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,543 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,545 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,547 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,550 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,552 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,554 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,556 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,558 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,561 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,563 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,565 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,568 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,570 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,572 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,575 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,578 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,580 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,582 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,585 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,587 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,590 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,592 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,594 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,596 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,598 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,601 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,603 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,606 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:14,608 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,610 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,612 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,615 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,617 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,619 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,621 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,623 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,625 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,627 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,630 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,632 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,634 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,636 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,638 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,640 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,642 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,644 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,646 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,648 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,650 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,653 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,655 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,657 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,659 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,661 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,663 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,665 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,668 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,670 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,672 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,674 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,676 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,678 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,680 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,683 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,685 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,687 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,689 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,692 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,694 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,696 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,698 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,700 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,702 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,704 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,706 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,709 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,711 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,713 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,715 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,717 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,719 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,722 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,724 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,726 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,728 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,731 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:14,733 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,734 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,736 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,738 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,740 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,743 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,745 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,747 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,749 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,751 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,753 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,755 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,757 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,760 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,762 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,764 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,766 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,768 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,770 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,773 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,775 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,777 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,779 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,782 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,784 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,786 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,788 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,791 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,793 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,795 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,797 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,799 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,802 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,804 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,806 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,808 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,811 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,813 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,815 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,817 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,820 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,822 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,824 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,826 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,829 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,831 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,833 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,835 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,838 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,840 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,842 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,845 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,847 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,849 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,851 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,854 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,856 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,859 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,861 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:14,863 creating build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,864 copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,866 copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,868 copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,870 copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,872 copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,875 copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,877 copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,879 copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,881 copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,883 copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,885 copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,887 copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,890 copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,892 copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,894 copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,896 copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,899 copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,901 copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,903 copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,905 copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,907 copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,909 copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,911 copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,914 copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,916 copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,918 copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,920 copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,922 copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,924 copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,926 copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,928 copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,930 copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,932 copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,934 copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,936 copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,937 copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,939 copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,941 copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,943 copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,945 copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,947 copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,949 copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,951 copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,953 copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,955 copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,957 copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,959 copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,961 copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,963 copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,965 copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,968 copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,970 copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,972 copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,974 copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,976 copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,979 copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,981 copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,983 copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,985 copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,987 copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,990 copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,992 copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:14,994 creating build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:14,995 copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:14,997 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:14,999 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,001 copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,003 copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,006 copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,008 copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,010 copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,012 copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,014 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,016 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,019 copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,021 copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,023 copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,025 copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,027 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,030 copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,032 copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,034 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,036 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,038 copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,040 copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,042 copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,045 copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,047 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,049 copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,051 copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,054 copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,056 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,058 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,060 copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,062 copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,064 copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,066 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,069 copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,071 copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,073 copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,075 copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,077 copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,080 copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,082 copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,084 copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,086 copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,088 copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,091 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,093 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,095 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,097 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,099 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,102 copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,104 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,106 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,108 copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,110 copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,113 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,115 copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,117 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,119 copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:15,121 creating build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,122 copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,124 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,126 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,128 copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,130 copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,133 copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,135 copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,137 copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,139 copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,141 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,143 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,145 copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,147 copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,149 copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,151 copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,153 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,156 copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,158 copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,160 copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,162 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,164 copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,166 copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,169 copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,171 copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,173 copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,175 copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,178 copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,180 copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,182 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,184 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,186 copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,188 copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,190 copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,192 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,194 copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,196 copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,199 copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,201 copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,203 copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,205 copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,207 copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,209 copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,212 copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,214 copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,216 copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,218 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,220 copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,222 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,224 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,226 copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,229 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,231 copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,233 copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,235 copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,237 copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,239 copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,241 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,243 copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:15,245 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,248 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,250 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,252 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,254 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,256 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,258 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,260 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,262 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,264 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,266 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,268 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,270 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,272 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,274 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,276 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,278 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,281 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,283 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,285 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,287 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,289 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,291 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,294 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,296 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,298 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,300 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,302 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,304 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,307 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,309 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,311 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,313 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,315 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,317 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,319 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,322 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,324 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,326 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,328 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,330 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,332 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,334 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,336 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,339 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,341 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,343 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,345 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,347 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,349 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,351 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,354 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,356 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,358 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,360 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,362 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,365 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,367 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:15,369 copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016 2025-11-27T00:43:15,371 copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,373 copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,376 copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,378 copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,380 copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,382 copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,384 copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,386 copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,389 copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,391 copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,393 copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,395 copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,397 copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,399 copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,401 copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,403 copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,405 copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,407 copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,409 copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,412 copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,414 copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,416 copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,418 copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,420 copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,422 copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:15,424 copying lm_eval/tasks/humaneval/humaneval.yaml -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:15,426 copying lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:15,429 copying lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:15,431 copying lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:15,433 copying lm_eval/tasks/humaneval/humaneval_64.yaml -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:15,435 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,438 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,440 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,442 copying lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,444 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,446 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,448 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:15,451 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,453 copying lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,455 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,457 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,459 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,461 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,463 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:15,465 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,467 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,470 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,472 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,474 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,476 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,478 copying lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:15,480 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,483 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,485 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,487 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,489 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,491 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,494 copying lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:15,496 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,499 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,501 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,503 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,505 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,508 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,510 copying lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:15,512 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,514 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,516 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,518 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,521 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,523 copying lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,525 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:15,527 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,529 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,532 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,534 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,536 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,539 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,541 copying lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:15,543 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,545 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,547 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,550 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,552 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,554 copying lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,557 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:15,559 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,561 copying lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,563 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,565 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,567 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,569 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,571 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:15,573 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,575 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,578 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,580 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,582 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,584 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,586 copying lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:15,589 copying lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,591 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,593 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,595 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,597 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,599 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,602 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:15,604 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,606 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,608 copying lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,610 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,613 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,615 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,617 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:15,620 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,622 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,624 copying lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,626 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,628 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,630 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,632 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:15,634 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,637 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,639 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,641 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,643 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,645 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,647 copying lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:15,650 copying lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,652 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,654 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,656 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,658 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,660 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,662 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:15,664 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,667 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,669 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,671 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,674 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,676 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,678 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,680 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,682 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,684 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,686 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,689 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,691 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,693 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,695 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,697 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,699 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,701 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,703 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,706 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,708 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,710 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,712 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,714 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,716 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,718 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,721 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,723 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,725 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,727 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,730 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,732 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,734 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,736 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,738 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,740 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,742 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,744 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,746 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,748 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,750 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,753 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,755 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,757 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,759 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,761 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,764 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,766 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,768 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,770 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,772 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,774 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,777 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,779 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,781 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,783 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,786 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,788 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,790 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,792 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,794 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,796 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:15,799 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,801 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,803 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,805 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,807 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,809 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,812 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,814 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,816 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,818 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,820 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,822 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,825 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,827 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,829 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,831 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,833 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,836 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,838 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,841 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,843 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,846 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,848 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,850 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,853 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,855 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,857 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,859 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,861 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,864 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,866 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,868 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,870 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,873 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,875 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,877 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,880 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,882 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,884 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,887 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,889 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,891 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,894 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,896 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,898 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,901 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,903 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,905 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,908 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,910 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,912 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,914 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,916 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,918 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,920 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,922 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,925 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,927 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,929 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,931 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,933 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,935 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:15,938 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,940 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,942 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,944 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,946 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,949 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,951 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,953 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,955 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,957 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,959 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,962 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,964 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,966 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,968 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,971 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,973 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,975 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,977 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,979 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,981 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,983 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,986 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,988 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,990 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,992 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,994 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,997 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:15,999 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,001 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,004 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,006 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,008 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,010 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,013 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,015 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,017 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,019 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,022 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,024 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,026 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,028 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,030 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,032 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,034 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,036 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,039 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,041 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,043 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,045 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,048 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,050 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,052 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,055 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,057 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,059 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,061 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,063 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,066 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,068 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,070 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,072 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:16,075 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,077 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,079 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,082 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,084 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,086 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,088 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,091 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,093 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,095 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,097 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,099 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,102 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,104 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,106 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,108 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,110 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,112 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,114 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,117 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,119 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,121 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,123 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,125 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,128 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,130 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,133 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,135 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,137 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,140 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,142 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,144 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,147 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,149 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,151 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,153 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,156 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,158 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,160 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,163 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,165 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,167 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,170 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,172 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,174 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,176 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,179 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,181 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,183 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,186 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,188 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,190 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,193 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,195 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,197 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,199 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,202 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,204 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,206 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,208 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,211 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,213 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:16,215 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,218 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,220 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,223 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,225 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,228 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,230 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,233 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,235 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,238 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,241 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,243 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,246 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,249 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,252 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,254 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,257 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,260 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,263 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,266 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,268 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,271 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,274 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,276 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,279 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,282 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,284 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,287 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,289 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,292 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,294 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,297 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,299 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,302 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,304 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,307 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,309 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,312 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,314 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,317 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,319 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,322 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,324 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,327 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,329 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,332 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,334 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,336 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,339 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,341 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,343 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,346 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,348 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,350 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,353 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,355 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,357 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,360 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,362 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,364 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,367 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,369 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:16,371 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,373 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,376 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,378 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,380 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,383 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,385 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,388 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,390 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,393 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,395 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,398 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,400 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,402 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,405 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,407 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,409 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,412 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,414 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,417 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,419 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,422 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,424 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,427 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,430 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,432 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,435 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,437 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,440 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,442 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,445 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,447 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,450 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,452 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,455 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,457 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,459 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,462 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,464 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,467 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,469 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,472 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,474 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,476 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,479 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,481 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,483 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,486 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,488 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,490 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,493 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,495 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,497 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,499 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,502 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,504 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,507 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,509 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,512 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,514 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,517 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,519 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:16,522 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,524 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,527 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,529 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,532 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,535 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,538 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,540 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,543 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,545 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,547 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,550 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,552 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,555 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,557 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,560 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,562 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,565 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,568 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,570 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,572 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,576 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,578 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,580 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,582 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,585 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,587 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,589 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,591 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,593 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,595 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,597 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,600 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,602 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,604 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,606 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,608 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,611 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,613 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,615 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,617 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,619 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,621 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,624 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,626 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,628 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,630 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,632 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,634 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,637 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,639 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,641 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,643 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,645 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,647 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,649 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,651 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,654 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,656 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,658 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,660 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,662 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:16,664 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,666 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,669 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,671 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,673 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,675 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,677 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,679 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,681 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,683 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,686 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,688 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,690 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,692 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,695 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,697 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,699 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,701 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,703 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,705 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,707 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,709 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,711 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,713 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,716 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,718 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,720 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,722 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,724 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,727 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,730 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,732 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,734 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,737 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,739 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,741 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,743 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,745 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,747 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,749 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,752 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,754 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,756 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,758 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,761 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,763 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,765 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,767 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,769 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,771 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,773 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,775 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,778 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,780 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,782 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,784 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,787 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,789 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,791 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,793 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,795 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,798 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:16,800 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,802 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,804 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,807 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,809 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,811 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,813 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,815 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,817 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,820 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,822 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,824 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,826 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,828 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,831 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,833 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,835 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,837 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,839 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,842 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,844 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,846 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,848 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,850 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,852 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,855 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,857 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,859 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,862 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,864 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,866 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,868 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,870 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,872 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,874 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,877 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,879 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,881 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,883 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,885 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,888 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,890 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,893 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,896 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,899 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,902 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,905 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,907 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,910 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,913 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,915 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,918 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,921 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,924 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,927 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,930 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,933 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,935 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,938 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,941 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,943 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,946 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:16,949 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,951 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,954 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,956 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,959 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,962 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,964 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,967 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,970 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,973 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,975 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,978 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,981 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,983 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,986 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,989 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,991 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,993 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,995 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:16,998 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,000 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,002 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,005 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,007 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,009 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,011 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,013 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,015 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,018 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,020 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,022 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,025 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,027 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,029 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,031 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,034 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,036 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,038 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,041 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,043 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,045 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,047 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,049 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,052 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,054 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,056 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,058 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,060 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,062 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,064 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,067 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,069 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,071 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,073 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,076 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,078 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,080 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,082 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,084 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,087 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,089 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,092 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:17,094 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,096 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,098 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,101 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,103 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,106 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,108 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,110 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,112 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,115 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,117 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,119 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,121 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,124 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,126 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,128 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,131 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,133 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,135 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,137 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,139 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,142 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,144 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,146 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,148 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,150 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,152 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,154 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,157 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,159 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,161 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,164 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,167 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,169 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,171 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,174 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,176 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,178 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,180 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,182 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,184 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,186 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,189 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,191 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,193 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,195 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,197 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,199 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,201 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,204 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,207 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,210 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,212 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,215 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,217 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,219 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,221 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,224 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,226 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,228 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,231 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,233 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:17,235 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,238 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,240 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,243 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,245 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,248 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,250 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,253 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,256 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,258 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,260 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,263 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,265 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,267 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,269 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,271 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,274 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,276 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,278 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,280 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,282 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,284 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,287 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,289 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,291 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,293 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,295 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,297 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,299 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,302 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,304 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,306 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,308 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,310 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,312 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,314 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,317 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,319 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,321 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,323 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,325 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,327 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,330 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,332 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,334 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,337 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,339 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,342 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,344 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,346 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,348 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,351 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,353 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,355 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,357 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,359 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,361 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,363 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,365 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,367 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,370 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,372 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:17,374 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,376 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,378 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,381 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,383 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,385 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,387 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,389 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,391 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,394 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,396 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,398 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,400 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,402 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,404 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,407 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,409 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,411 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,413 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,415 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,417 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,420 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,422 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,424 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,426 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,428 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,430 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,433 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,435 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,437 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,439 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,442 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,444 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,446 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,448 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,451 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,453 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,455 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,458 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,460 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,463 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,465 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,467 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,469 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,472 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,474 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,476 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,478 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,480 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,482 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,485 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,487 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,490 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,492 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,494 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,497 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,499 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,501 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,503 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,506 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,508 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,510 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:17,513 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,516 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,519 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,521 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,523 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,525 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,527 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,530 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,532 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,535 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,537 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,539 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,542 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,544 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,546 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,548 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,551 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,553 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,555 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,557 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,559 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,562 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,564 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,566 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,568 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,571 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,573 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,575 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,577 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,579 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,582 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,584 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,587 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,589 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,591 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,593 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,595 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,597 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,599 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,602 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,604 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,606 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,608 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,611 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,613 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,615 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,617 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,619 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,622 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,624 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,626 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,629 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,631 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,633 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,635 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,638 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,640 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,642 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,645 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,647 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,649 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,651 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:17,653 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,655 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,658 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,660 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,662 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,664 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,666 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,668 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,671 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,673 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,675 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,677 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,679 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,681 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,683 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,685 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,688 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,690 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,693 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,695 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,697 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,699 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,701 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,703 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,706 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,708 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,710 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,712 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,714 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,716 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,719 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,721 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,723 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,725 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,727 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,730 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,732 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,734 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,737 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,739 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,741 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,743 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,745 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,748 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,750 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,752 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,754 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,757 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,759 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,761 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,763 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,765 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,767 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,770 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,772 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,774 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,776 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,778 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,781 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,783 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,785 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,787 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:17,790 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,792 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,794 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,796 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,798 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,800 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,803 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,805 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,807 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,809 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,811 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,814 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,816 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,818 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,820 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,822 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,824 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,826 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,828 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,830 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,832 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,834 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,836 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,839 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,841 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,843 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,845 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,847 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,849 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,851 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,853 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,855 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,857 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,860 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,862 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,864 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,866 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,868 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,871 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,873 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,875 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,877 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,879 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,881 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,883 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,885 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,887 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,890 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,892 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,894 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,896 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,898 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,900 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,902 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,905 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,907 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,909 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,911 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,913 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,915 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,917 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,920 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:17,922 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,924 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,926 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,928 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,930 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,932 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,934 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,936 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,938 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,940 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,942 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,944 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,946 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,948 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,951 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,953 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,955 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,957 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,959 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,962 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,964 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,966 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,969 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,971 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,974 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,976 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,978 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,981 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,983 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,985 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,987 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,989 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,991 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,993 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,995 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,997 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:17,999 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,001 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,003 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,005 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,007 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,010 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,012 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,014 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,016 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,018 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,020 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,022 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,024 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,026 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,029 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,031 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,033 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,035 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,037 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,039 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,041 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,043 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,045 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,047 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,049 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,051 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:18,053 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,055 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,057 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,059 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,061 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,063 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,065 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,068 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,070 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,072 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,074 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,076 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,078 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,080 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,082 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,084 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,086 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,089 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,091 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,093 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,095 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,097 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,099 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,101 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,103 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,105 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,107 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,109 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,111 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,113 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,115 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,117 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,120 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,122 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,124 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,126 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,128 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,130 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,133 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,135 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,137 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,139 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,141 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,143 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,146 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,148 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,150 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,152 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,154 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,156 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,158 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,160 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,162 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,165 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,167 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,169 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,171 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,173 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,175 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,177 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,180 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,182 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:18,184 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,186 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,188 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,191 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,193 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,195 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,197 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,200 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,202 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,204 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,207 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,209 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,211 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,213 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,215 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,217 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,219 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,221 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,223 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,225 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,227 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,229 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,232 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,234 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,236 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,238 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,240 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,242 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,244 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,246 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,248 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,251 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,253 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,255 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,257 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,259 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,261 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,263 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,265 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,267 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,269 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,271 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,273 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,275 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,278 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,280 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,282 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,284 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,286 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,288 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,291 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,293 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,295 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,297 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,299 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,301 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,303 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,305 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,307 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,310 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,312 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,314 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:18,316 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,318 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,321 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,322 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,325 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,327 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,329 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,331 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,333 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,335 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,338 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,340 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,342 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,344 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,346 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,348 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,350 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,352 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,355 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,357 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,359 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,362 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,364 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,367 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,369 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,371 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,374 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,376 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,378 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,380 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,382 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,384 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,386 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,388 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,390 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,392 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,395 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,397 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,399 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,402 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,404 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,407 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,410 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,412 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,414 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,417 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,419 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,421 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,424 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,426 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,428 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,430 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,433 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,435 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,437 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,439 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,441 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,444 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,446 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,449 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,451 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,454 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:18,456 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,459 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,461 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,463 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,465 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,467 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,469 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,471 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,473 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,476 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,478 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,480 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,483 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,485 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,487 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,489 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,491 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,493 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,495 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,497 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,500 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,502 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,504 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,506 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,508 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,510 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,512 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,514 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,516 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,518 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,520 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,523 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,525 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,527 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,529 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,531 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,533 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,535 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,537 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,539 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,542 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,544 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,546 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,548 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,550 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,552 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,554 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,556 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,558 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,560 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,562 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,564 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,566 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,568 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,570 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,572 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,574 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,576 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,579 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,581 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,583 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,585 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:18,587 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,589 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,591 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,593 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,595 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,597 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,599 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,602 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,604 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,606 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,608 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,610 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,612 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,614 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,616 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,618 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,620 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,623 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,625 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,627 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,629 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,631 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,633 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,635 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,638 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,640 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,642 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,644 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,646 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,649 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,651 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,653 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,655 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,657 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,659 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,662 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,665 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,667 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,670 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,672 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,674 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,677 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,679 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,682 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,684 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,687 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,689 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,692 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,694 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,697 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,699 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,702 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,704 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,707 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,709 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,711 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,714 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,716 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,719 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,721 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,724 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,726 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:18,729 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,731 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,733 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,736 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,738 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,741 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,743 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,746 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,748 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,750 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,753 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,755 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,758 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,760 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,762 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,765 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,767 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,770 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,772 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,775 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,777 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,780 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,782 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,784 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,786 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,788 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,790 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,792 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,794 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,796 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,798 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,800 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,802 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,804 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,806 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,808 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,810 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,812 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,814 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,817 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,819 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,821 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,823 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,825 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,827 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,829 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,832 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,834 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,836 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,838 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,840 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,842 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,844 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,846 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,848 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,850 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,852 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,854 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,856 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,859 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,861 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,863 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:18,865 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,867 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,869 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,871 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,874 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,876 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,878 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,880 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,882 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,884 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,886 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,889 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,891 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,893 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,895 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,896 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,899 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,901 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,903 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,905 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,907 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,909 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,911 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,913 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,915 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,917 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,919 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,921 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,923 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,925 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,927 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,929 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,932 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,934 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,936 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,938 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,940 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,942 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,944 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,946 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,948 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,950 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,952 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,954 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,956 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,958 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,960 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,962 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,964 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,966 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,969 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,971 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,973 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,975 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,977 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,979 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,981 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,983 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,985 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,987 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,989 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,992 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:18,994 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:18,996 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:18,998 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,000 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,002 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,004 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,006 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,008 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,010 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,012 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,014 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,016 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,018 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,020 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,023 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,025 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,027 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,029 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,031 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,033 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,035 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,037 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,039 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,041 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,044 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,046 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,048 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,050 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,052 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,054 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,056 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,058 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,060 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,062 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,064 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,067 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,069 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,071 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,073 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,075 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,077 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,080 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,082 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,084 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,086 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,088 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,090 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,092 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,094 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,096 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,099 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,101 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,103 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,106 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,109 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,112 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,114 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,117 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,120 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,122 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,125 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,128 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:19,131 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,134 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,136 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,139 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,142 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,144 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,147 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,150 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,153 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,155 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,158 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,161 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,164 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,166 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,169 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,172 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,175 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,177 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,180 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,183 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,185 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,188 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,191 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,194 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,196 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,199 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,202 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,205 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,207 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,209 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,211 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,213 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,215 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,217 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,219 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,221 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,224 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,226 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,228 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,230 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,232 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,234 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,236 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,239 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,241 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,243 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,245 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,247 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,249 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,251 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,253 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,255 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,257 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,260 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,262 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,264 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,266 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,268 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,270 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,272 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,274 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,277 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:19,279 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,281 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,283 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,285 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,287 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,289 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,292 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,294 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,296 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,298 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,300 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,302 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,304 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,306 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,309 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,311 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,313 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,315 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,317 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,319 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,321 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,323 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,325 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,328 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,330 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,332 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,334 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,336 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,338 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,340 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,343 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,345 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,347 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,349 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,351 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,353 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,355 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,357 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,359 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,361 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,363 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,365 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,367 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,370 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,372 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,374 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,376 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,378 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,381 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,383 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,385 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,387 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,389 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,392 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,394 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,396 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,398 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,400 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,402 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,404 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,406 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,408 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:19,410 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,413 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,415 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,417 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,419 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,421 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,423 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,426 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,428 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,430 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,432 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,434 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,436 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,439 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,441 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,443 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,445 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,447 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,450 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,452 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,454 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,456 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,458 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,461 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,463 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,465 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,467 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,469 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,471 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,473 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,475 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,477 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,480 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,482 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,484 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,486 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,488 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,490 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,492 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,495 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,497 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,499 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,501 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,503 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,505 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,507 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,510 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,512 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,514 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,516 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,518 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,520 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,523 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,525 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,527 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,529 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,531 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,533 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,535 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,537 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,540 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,542 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:19,544 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,546 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,548 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,551 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,553 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,555 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,557 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,559 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,562 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,564 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,566 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,568 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,571 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,573 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,575 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,577 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,579 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,581 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,583 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,586 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,588 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,590 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,592 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,594 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,596 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,598 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,600 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,603 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,605 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,607 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,609 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,611 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,613 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,615 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,618 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,620 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,622 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,624 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,626 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,628 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,630 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,632 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,634 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,636 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,638 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,640 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,642 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,644 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,646 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,648 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,650 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,652 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,654 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,656 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,659 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,661 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,663 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,665 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,667 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,669 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,671 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,673 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:19,675 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,678 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,680 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,682 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,684 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,686 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,688 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,690 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,692 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,694 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,696 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,698 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,700 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,702 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,704 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,706 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,708 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,710 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,712 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,714 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,716 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,718 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,720 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,722 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,725 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,727 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,729 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,731 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,733 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,736 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,738 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,740 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,742 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,744 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,746 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,748 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,750 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,753 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,755 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,757 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,759 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,761 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,764 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,766 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,768 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,770 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,773 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,775 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,777 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,779 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,782 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,784 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,786 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,788 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,791 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,793 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,795 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,798 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,801 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,803 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,805 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,807 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:19,810 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,812 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,814 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,816 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,819 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,821 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,823 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,825 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,828 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,830 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,832 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,834 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,836 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,839 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,841 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,843 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,845 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,847 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,850 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,852 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,854 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,856 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,858 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,860 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,862 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,864 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,866 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,868 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,870 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,873 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,875 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,877 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,879 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,881 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,883 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,886 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,888 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,890 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,892 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,894 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,896 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,898 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,901 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,903 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,905 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,907 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,909 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,911 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,913 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,915 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,917 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,920 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,921 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,924 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,925 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,927 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,929 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,931 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,933 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,936 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,938 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,940 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:19,942 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,944 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,946 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,948 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,950 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,952 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,954 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,956 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,959 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,961 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,963 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,965 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,966 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,969 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,970 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,972 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,975 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,977 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,979 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,981 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,983 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,985 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,988 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,990 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,992 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,994 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,996 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:19,998 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,000 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,002 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,005 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,007 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,009 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,011 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,013 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,015 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,017 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,020 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,022 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,023 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,026 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,028 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,030 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,032 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,034 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,036 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,038 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,040 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,042 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,045 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,047 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,049 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,051 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,054 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,056 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,058 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,060 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,062 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,064 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,066 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,068 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,070 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:20,072 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,074 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,076 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,079 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,081 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,083 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,085 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,087 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,089 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,091 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,093 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,095 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,098 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,100 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,102 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,104 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,106 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,108 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,110 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,113 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,115 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,117 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,119 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,121 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,123 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,126 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,128 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,130 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,132 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,134 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,136 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,138 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,140 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,142 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,144 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,146 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,148 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,150 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,152 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,154 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,157 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,159 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,161 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,163 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,165 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,167 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,169 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,171 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,173 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,175 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,177 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,180 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,182 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,184 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,186 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,188 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,190 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,192 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,193 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,195 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,197 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,199 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:20,201 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,204 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,206 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,208 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,210 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,212 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,214 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,216 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,218 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,220 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,223 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,225 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,227 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,229 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,231 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,233 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,235 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,237 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,239 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,241 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,243 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,245 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,247 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,250 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,252 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,254 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,256 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,258 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,260 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,262 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,264 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,266 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,268 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,270 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,273 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,275 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,277 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,279 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,281 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,283 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,286 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,288 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,290 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,292 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,294 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,296 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,298 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,300 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,302 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,304 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,306 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,308 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,310 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,312 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,314 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,316 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,319 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,321 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,323 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,325 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,327 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,330 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:20,332 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,334 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,336 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,339 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,341 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,343 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,345 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,347 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,350 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,352 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,354 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,356 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,358 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,360 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,363 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,365 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,367 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,369 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,371 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,374 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,376 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,378 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,380 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,383 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,385 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,387 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,389 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,392 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,394 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,396 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,399 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,401 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,403 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,405 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,407 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,410 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,412 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,414 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,416 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,418 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,420 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,422 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,425 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,427 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,429 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,431 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,434 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,436 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,438 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,440 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,443 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,445 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,447 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,450 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,452 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,454 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,457 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,459 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,461 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,463 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,465 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,467 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:20,470 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,472 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,474 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,476 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,478 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,481 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,483 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,485 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,487 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,489 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,492 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,494 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,496 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,498 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,501 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,503 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,505 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,507 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,510 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,512 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,515 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,517 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,519 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,521 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,524 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,526 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,528 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,530 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,532 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,535 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,537 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,539 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,541 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,544 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,546 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,548 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,550 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,553 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,555 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,557 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,559 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,561 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,564 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,566 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,568 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,571 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,573 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,576 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,578 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,580 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,582 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,584 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,586 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,588 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,590 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,593 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,595 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,597 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,599 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,602 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,604 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,606 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:20,609 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,611 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,613 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,616 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,618 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,620 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,623 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,625 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,627 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,630 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,632 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,634 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,637 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,639 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,641 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,643 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,645 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,648 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,650 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,652 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,655 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,657 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,659 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,661 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,664 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,666 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,668 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,671 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,673 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,675 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,677 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,680 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,682 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,685 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,687 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,689 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,692 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,694 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,696 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,698 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,700 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,703 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,705 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,707 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,709 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,711 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,714 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,716 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,718 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,721 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,723 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,726 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,728 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,730 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,733 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,735 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,737 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,740 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,742 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,744 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,746 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,749 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:20,751 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,754 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,756 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,758 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,760 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,762 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,764 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,767 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,769 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,771 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,773 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,776 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,778 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,780 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,783 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,785 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,787 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,790 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,792 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,795 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,797 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,799 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,801 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,804 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,806 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,809 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,811 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,814 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,816 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,819 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,821 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,823 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,825 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,828 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,830 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,832 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,835 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,837 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,839 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,841 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,843 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,846 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,848 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,851 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,853 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,855 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,858 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,860 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,862 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,865 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,867 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,869 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,872 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,874 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,876 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,879 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,881 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,883 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,885 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,887 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,890 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,892 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:20,894 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,897 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,899 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,901 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,903 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,906 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,908 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,910 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,913 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,915 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,917 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,919 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,922 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,924 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,926 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,929 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,931 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,933 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,935 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,938 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,940 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,942 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,944 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,947 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,949 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,951 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,954 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,956 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,958 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,961 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,963 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,966 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,968 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,971 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,973 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,975 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,978 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,980 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,982 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,985 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,987 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,989 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,992 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,994 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,996 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:20,999 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,001 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,003 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,006 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,008 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,010 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,012 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,015 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,017 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,019 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,022 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,024 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,026 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,029 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,031 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,034 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,036 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:21,039 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,041 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,043 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,046 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,048 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,050 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,053 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,055 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,058 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,060 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,062 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,064 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,067 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,069 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,071 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,074 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,076 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,079 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,081 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,083 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,086 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,088 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,091 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,093 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,095 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,098 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,100 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,103 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,105 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,107 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,110 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,112 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,115 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,117 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,120 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,122 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,124 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,127 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,129 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,131 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,134 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,136 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,138 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,141 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,143 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,146 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,148 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,151 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,153 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,155 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,158 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,160 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,163 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,165 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,168 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,170 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,172 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,175 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,177 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,180 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,182 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,184 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:21,186 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,189 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,191 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,193 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,196 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,198 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,200 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,203 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,205 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,207 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,210 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,212 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,214 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,217 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,219 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,222 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,224 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,226 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,229 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,231 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,233 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,236 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,239 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,241 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,243 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,245 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,248 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,250 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,252 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,254 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,256 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,259 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,261 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,264 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,266 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,268 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,271 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,273 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,275 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,278 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,280 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,283 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,285 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,288 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,290 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,293 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,295 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,298 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,301 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,304 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,306 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,309 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,311 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,314 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,317 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,319 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,322 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,325 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,327 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,330 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,333 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,335 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:21,338 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,341 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,343 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,346 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,348 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,351 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,353 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,356 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,358 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,361 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,363 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,366 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,368 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,371 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,373 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,376 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,378 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,381 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,383 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,385 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,388 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,390 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,392 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,394 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,397 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,399 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,401 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,403 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,405 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,407 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,410 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,412 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,415 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,417 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,419 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,422 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,424 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,426 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,429 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,431 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,433 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,435 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,438 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,440 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,442 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,444 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,447 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,449 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,451 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,453 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,456 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,458 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,460 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,463 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,465 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,467 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,470 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,472 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,474 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,477 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,479 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,481 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:21,484 copying lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/lib/lm_eval/tasks/histoires_morales 2025-11-27T00:43:21,486 copying lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,489 copying lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,491 copying lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,494 copying lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,496 copying lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,498 copying lm_eval/tasks/cabbq/cabbq_age.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,501 copying lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,503 copying lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,505 copying lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,508 copying lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,510 copying lm_eval/tasks/cabbq/cabbq.yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:21,512 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,515 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,517 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,519 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,521 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,524 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,526 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,528 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,531 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,533 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,536 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,538 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,540 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,543 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,545 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,547 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,549 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,552 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,554 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,557 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,559 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:21,561 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,564 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,566 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,569 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,571 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,573 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,575 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,578 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,580 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,582 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,584 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,587 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,589 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,592 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,594 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,596 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,599 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,601 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,604 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,606 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,609 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,611 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,613 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,616 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,618 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,621 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,623 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,625 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,628 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,630 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,633 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,635 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,638 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,641 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,643 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,645 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,648 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,650 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,652 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,655 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,657 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,660 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,662 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,664 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,667 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,669 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,672 copying lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,674 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,676 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,679 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,681 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,683 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,686 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,688 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,691 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,693 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,695 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,698 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,700 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,703 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,705 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,708 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,710 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,713 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,715 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,718 copying lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,720 copying lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,723 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,726 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,728 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,730 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,733 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,735 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:21,737 copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2 2025-11-27T00:43:21,740 copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2 2025-11-27T00:43:21,742 copying lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:43:21,745 copying lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:43:21,747 copying lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:43:21,749 copying lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:43:21,751 creating build/lib/lm_eval/tasks/commonsense_qa 2025-11-27T00:43:21,753 copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa 2025-11-27T00:43:21,755 creating build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,756 copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,759 copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,761 copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,764 copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,766 copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:21,768 creating build/lib/lm_eval/tasks/openbookqa 2025-11-27T00:43:21,770 copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa 2025-11-27T00:43:21,772 creating build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,773 copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,776 copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,778 copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,780 copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,782 copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,785 copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,787 copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,790 copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,792 copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,794 copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,797 copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,799 copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,802 copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,804 copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,806 copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,809 copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,811 copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,813 copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,816 copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,818 copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,821 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,823 copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,826 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,828 copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,830 copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,833 copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,835 copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,837 copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,840 copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,842 copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,844 copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,847 copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,849 copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,852 copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,854 copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,856 copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,859 copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,861 copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,864 copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,866 copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,868 copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,871 copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,873 copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,875 copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,878 copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,880 copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,882 copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,885 copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,887 copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,890 copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,892 copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,894 copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,897 copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,899 copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,902 copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,904 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,906 copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,909 copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,911 copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,914 copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,916 copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,919 copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,921 copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,923 copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,926 copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,928 copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,931 copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,934 copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,936 copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,939 copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,941 copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,943 copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,946 copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,948 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,951 copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,953 copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,955 copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,958 copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,960 copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,962 copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,965 copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,967 copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,970 copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,972 copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,974 copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,977 copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,979 copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,981 copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,984 copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,986 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,989 copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,991 copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,993 copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,996 copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:21,998 copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,000 copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,003 copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,005 copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,007 copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,010 copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,012 copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,014 copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,017 copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,019 copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,021 copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,024 copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,027 copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,030 copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,033 copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,036 copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,038 copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,041 copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,044 copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,047 copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,050 copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,053 copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,056 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,059 copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,062 copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:43:22,065 creating build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,066 copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,069 copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,072 copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,075 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,078 copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,081 copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,084 copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,087 copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,090 copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,093 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,095 copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,098 copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,101 copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,104 copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,107 copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,110 copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,112 copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,115 copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,118 copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,121 copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,124 copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,127 copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,129 copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,132 copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,134 copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,137 copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,139 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,142 copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,144 copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,146 copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,149 copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,151 copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,153 copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,155 copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,158 copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,160 copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,162 copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,164 copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,167 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,169 copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,171 copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,174 copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,176 copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,179 copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,181 copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,183 copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,185 copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,188 copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,190 copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,192 copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,195 copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,197 copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,200 copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,202 copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,205 copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,207 copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,210 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,212 copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,214 copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,217 copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,219 copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,221 copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,224 copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,226 copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,229 copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,231 copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,233 copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,235 copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,238 copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,240 copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,243 copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,245 copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,247 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,250 copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,252 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,255 copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,257 copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,259 copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,262 copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,264 copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,267 copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,269 copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,272 copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,274 copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,277 copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,279 copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,281 copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,284 copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,286 copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,288 copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,291 copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,293 copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,295 copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,298 copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,300 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,303 copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,305 copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,307 copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,310 copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,312 copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,314 copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,317 copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,319 copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,322 copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,324 copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,326 copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,329 copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,331 copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,333 copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,336 copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,338 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,341 copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,343 copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,346 copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,348 copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,350 copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,352 copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,355 copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,357 copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,359 copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,362 copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,365 copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,367 copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,369 copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,372 copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,374 copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,377 copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,379 copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,382 copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,384 copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,387 copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,389 copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,391 copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,394 copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,396 copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,399 copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,401 copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,404 copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,406 copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,409 copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,412 copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,414 copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,416 copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,419 copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,421 copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,423 copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,426 copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,428 copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,430 copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,432 copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,435 copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,437 copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,440 copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,442 copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,444 copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,447 copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,449 copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,452 copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,454 copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,456 copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,459 copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,461 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,463 copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,466 copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,469 copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,471 copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,473 copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:43:22,476 creating build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,477 copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,479 copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,482 copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,484 copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,486 copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,489 copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,491 copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,494 copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,496 copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,498 copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,501 copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:22,503 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,505 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,508 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,511 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,514 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,516 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,519 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,521 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,523 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,526 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,528 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,531 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,533 copying lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,536 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,538 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:22,541 copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:22,543 copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:22,546 copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:22,548 copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:22,551 copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:22,553 copying lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,555 copying lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,558 copying lm_eval/tasks/libra/ru_qasper.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,560 copying lm_eval/tasks/libra/matreshka_names.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,562 copying lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,565 copying lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,567 copying lm_eval/tasks/libra/ru_quality.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,569 copying lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,572 copying lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,574 copying lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,576 copying lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,579 copying lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,581 copying lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,583 copying lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,585 copying lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,588 copying lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,590 copying lm_eval/tasks/libra/librusec_mhqa.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,592 copying lm_eval/tasks/libra/ru_gsm100.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,594 copying lm_eval/tasks/libra/passkey.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,597 copying lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,599 copying lm_eval/tasks/libra/long_context_multiq.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,601 copying lm_eval/tasks/libra/librusec_history.yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:22,604 copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,606 copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,609 copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,611 copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,613 copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,616 copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,618 copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:22,620 creating build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:22,621 copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:22,624 copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:22,626 copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:22,629 copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:22,631 creating build/lib/lm_eval/tasks/benchmarks/flan 2025-11-27T00:43:22,632 copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2025-11-27T00:43:22,635 copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2025-11-27T00:43:22,638 creating build/lib/lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:43:22,639 copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:43:22,642 copying lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,644 copying lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,646 copying lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,649 copying lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,651 copying lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,653 copying lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:22,656 copying lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,658 copying lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,660 copying lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,663 copying lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,665 copying lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,668 copying lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:22,670 copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs 2025-11-27T00:43:22,673 creating build/lib/lm_eval/tasks/glue/cola 2025-11-27T00:43:22,674 copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola 2025-11-27T00:43:22,677 copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli 2025-11-27T00:43:22,679 copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli 2025-11-27T00:43:22,681 creating build/lib/lm_eval/tasks/glue/sst2 2025-11-27T00:43:22,682 copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2 2025-11-27T00:43:22,685 creating build/lib/lm_eval/tasks/glue/wnli 2025-11-27T00:43:22,686 copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli 2025-11-27T00:43:22,688 creating build/lib/lm_eval/tasks/glue/qqp 2025-11-27T00:43:22,689 copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp 2025-11-27T00:43:22,692 creating build/lib/lm_eval/tasks/glue/qnli 2025-11-27T00:43:22,693 copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli 2025-11-27T00:43:22,695 creating build/lib/lm_eval/tasks/glue/mrpc 2025-11-27T00:43:22,697 copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc 2025-11-27T00:43:22,699 creating build/lib/lm_eval/tasks/glue/rte 2025-11-27T00:43:22,700 copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte 2025-11-27T00:43:22,703 copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,705 copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,707 copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,710 copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,712 copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,714 copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,717 copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,719 copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,722 copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,724 copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,726 copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,729 copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,731 copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,734 copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,736 copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,738 copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,741 copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,743 copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,745 copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,747 copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,750 copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,752 copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,754 copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,757 copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,759 copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,761 copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,764 copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,766 copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,768 copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,771 copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,773 copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,775 copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,778 copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,780 copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,782 copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,784 copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,787 copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:22,789 creating build/lib/lm_eval/tasks/swag 2025-11-27T00:43:22,790 copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag 2025-11-27T00:43:22,793 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:22,795 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:22,798 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:22,800 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:22,802 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,805 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,807 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,810 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,812 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,814 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:22,816 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,819 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,821 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,823 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,825 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,827 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,830 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,832 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,834 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,836 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,839 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,841 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,843 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,846 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,848 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,850 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,852 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,855 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,857 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,859 copying lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,861 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,863 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,866 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,868 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,870 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:22,873 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:43:22,875 copying lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:43:22,877 copying lm_eval/tasks/babilong/babilong_qa14.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,879 copying lm_eval/tasks/babilong/babilong_qa7.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,881 copying lm_eval/tasks/babilong/babilong_qa16.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,884 copying lm_eval/tasks/babilong/babilong_qa6.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,886 copying lm_eval/tasks/babilong/babilong_qa20.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,888 copying lm_eval/tasks/babilong/babilong_qa12.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,890 copying lm_eval/tasks/babilong/babilong_qa4.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,892 copying lm_eval/tasks/babilong/babilong_qa13.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,895 copying lm_eval/tasks/babilong/babilong_qa1.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,897 copying lm_eval/tasks/babilong/babilong_qa11.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,899 copying lm_eval/tasks/babilong/babilong_qa9.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,901 copying lm_eval/tasks/babilong/babilong_qa15.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,904 copying lm_eval/tasks/babilong/babilong_qa18.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,906 copying lm_eval/tasks/babilong/babilong.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,908 copying lm_eval/tasks/babilong/babilong_qa17.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,910 copying lm_eval/tasks/babilong/babilong_qa3.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,912 copying lm_eval/tasks/babilong/babilong_qa8.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,914 copying lm_eval/tasks/babilong/babilong_qa5.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,917 copying lm_eval/tasks/babilong/babilong_qa2.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,919 copying lm_eval/tasks/babilong/babilong_longctx.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,921 copying lm_eval/tasks/babilong/babilong_qa10.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,924 copying lm_eval/tasks/babilong/babilong_qa19.yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:22,926 copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,928 copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,930 copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,933 copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,935 copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,937 copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,939 copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,942 copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,944 copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,946 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,948 copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,951 copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,953 copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,955 copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,957 copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,959 copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,961 copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,963 copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,966 copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,968 copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,970 copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,972 copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,974 copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,977 copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,979 copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,981 copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,983 copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,986 copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,988 copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,990 copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,992 copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,994 copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,996 copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:22,999 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,001 copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,003 copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,005 copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,007 copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,009 copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,012 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,014 copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,016 copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,018 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,021 copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,023 copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,025 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,027 copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,029 copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,031 copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,033 copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,035 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,038 copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,040 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,042 copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,044 copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,046 copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,048 copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,051 copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,053 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,055 copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,057 copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,059 copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,062 copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,064 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,066 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,068 copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,070 copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,073 copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:23,075 copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa 2025-11-27T00:43:23,077 creating build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,078 copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,080 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,083 copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,085 copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,087 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,089 copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,092 copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,094 copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,096 copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,098 copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,100 copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,102 copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:23,105 copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,107 copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,109 copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,111 copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,113 copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,115 copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,117 copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,119 copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,121 copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,124 copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,126 copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,128 copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,130 copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,133 copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,135 copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,137 copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,139 copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,142 copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,144 copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,146 copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,148 copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,150 copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,153 copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,156 copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,160 copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,162 copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,165 copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,168 copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,172 copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,174 copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,176 copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,178 copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,181 copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,183 copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,185 copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,187 copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,189 copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,191 copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,193 copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,195 copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,197 copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,199 copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,202 copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,204 copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,206 copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,208 copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,211 copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,213 copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,215 copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,217 copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,220 copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,222 copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,224 copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:23,226 copying lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/lib/lm_eval/tasks/egyhellaswag 2025-11-27T00:43:23,229 copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,231 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,233 copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,235 copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,237 copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,240 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,242 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,244 copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,246 copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,249 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,251 copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,253 copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,255 copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,257 copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,259 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,261 copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,263 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,266 copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,268 copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,270 copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,272 copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,274 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,276 copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,278 copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,280 copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,282 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,284 copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,287 copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,289 copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,291 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,293 copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,295 copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:23,297 creating build/lib/lm_eval/tasks/fld 2025-11-27T00:43:23,299 copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld 2025-11-27T00:43:23,301 copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld 2025-11-27T00:43:23,303 copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld 2025-11-27T00:43:23,305 copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld 2025-11-27T00:43:23,308 copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,310 copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,312 copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,314 copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,316 copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,319 copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,321 copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,323 copying lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,325 copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:23,327 copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia 2025-11-27T00:43:23,330 copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa 2025-11-27T00:43:23,332 copying lm_eval/tasks/common_voice/common_voice_en.yaml -> build/lib/lm_eval/tasks/common_voice 2025-11-27T00:43:23,334 copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race 2025-11-27T00:43:23,336 creating build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,337 copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,339 copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,341 copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,343 copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,345 copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:23,348 copying lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/lib/lm_eval/tasks/darijahellaswag 2025-11-27T00:43:23,350 copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa 2025-11-27T00:43:23,352 creating build/lib/lm_eval/tasks/gsm_plus 2025-11-27T00:43:23,353 copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus 2025-11-27T00:43:23,355 copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus 2025-11-27T00:43:23,358 copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,360 copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,363 copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,365 copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,367 copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,369 copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,371 copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,373 copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,375 copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,377 copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,379 copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,381 copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:23,384 copying lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,386 copying lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,388 copying lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,390 copying lm_eval/tasks/global_piqa/prompted/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,393 copying lm_eval/tasks/global_piqa/prompted/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,395 copying lm_eval/tasks/global_piqa/prompted/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,397 copying lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,399 copying lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,401 copying lm_eval/tasks/global_piqa/prompted/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,403 copying lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,405 copying lm_eval/tasks/global_piqa/prompted/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,407 copying lm_eval/tasks/global_piqa/prompted/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,409 copying lm_eval/tasks/global_piqa/prompted/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,411 copying lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,413 copying lm_eval/tasks/global_piqa/prompted/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,415 copying lm_eval/tasks/global_piqa/prompted/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,417 copying lm_eval/tasks/global_piqa/prompted/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,419 copying lm_eval/tasks/global_piqa/prompted/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,421 copying lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,423 copying lm_eval/tasks/global_piqa/prompted/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,425 copying lm_eval/tasks/global_piqa/prompted/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,427 copying lm_eval/tasks/global_piqa/prompted/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,430 copying lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,432 copying lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,434 copying lm_eval/tasks/global_piqa/prompted/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,436 copying lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,438 copying lm_eval/tasks/global_piqa/prompted/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,440 copying lm_eval/tasks/global_piqa/prompted/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,442 copying lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,445 copying lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,447 copying lm_eval/tasks/global_piqa/prompted/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,449 copying lm_eval/tasks/global_piqa/prompted/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,451 copying lm_eval/tasks/global_piqa/prompted/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,454 copying lm_eval/tasks/global_piqa/prompted/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,456 copying lm_eval/tasks/global_piqa/prompted/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,458 copying lm_eval/tasks/global_piqa/prompted/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,461 copying lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,463 copying lm_eval/tasks/global_piqa/prompted/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,465 copying lm_eval/tasks/global_piqa/prompted/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,467 copying lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,469 copying lm_eval/tasks/global_piqa/prompted/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,472 copying lm_eval/tasks/global_piqa/prompted/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,474 copying lm_eval/tasks/global_piqa/prompted/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,476 copying lm_eval/tasks/global_piqa/prompted/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,478 copying lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,480 copying lm_eval/tasks/global_piqa/prompted/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,483 copying lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,485 copying lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,487 copying lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,489 copying lm_eval/tasks/global_piqa/prompted/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,491 copying lm_eval/tasks/global_piqa/prompted/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,494 copying lm_eval/tasks/global_piqa/prompted/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,496 copying lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,498 copying lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,501 copying lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,503 copying lm_eval/tasks/global_piqa/prompted/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,505 copying lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,507 copying lm_eval/tasks/global_piqa/prompted/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,509 copying lm_eval/tasks/global_piqa/prompted/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,512 copying lm_eval/tasks/global_piqa/prompted/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,514 copying lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,516 copying lm_eval/tasks/global_piqa/prompted/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,518 copying lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,520 copying lm_eval/tasks/global_piqa/prompted/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,522 copying lm_eval/tasks/global_piqa/prompted/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,524 copying lm_eval/tasks/global_piqa/prompted/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,527 copying lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,529 copying lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,532 copying lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,534 copying lm_eval/tasks/global_piqa/prompted/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,536 copying lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,539 copying lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,541 copying lm_eval/tasks/global_piqa/prompted/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,543 copying lm_eval/tasks/global_piqa/prompted/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,545 copying lm_eval/tasks/global_piqa/prompted/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,548 copying lm_eval/tasks/global_piqa/prompted/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,550 copying lm_eval/tasks/global_piqa/prompted/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,552 copying lm_eval/tasks/global_piqa/prompted/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,554 copying lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,556 copying lm_eval/tasks/global_piqa/prompted/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,558 copying lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,560 copying lm_eval/tasks/global_piqa/prompted/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,562 copying lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,565 copying lm_eval/tasks/global_piqa/prompted/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,567 copying lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,569 copying lm_eval/tasks/global_piqa/prompted/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,571 copying lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,573 copying lm_eval/tasks/global_piqa/prompted/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,576 copying lm_eval/tasks/global_piqa/prompted/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,578 copying lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,580 copying lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,582 copying lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,584 copying lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,587 copying lm_eval/tasks/global_piqa/prompted/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,589 copying lm_eval/tasks/global_piqa/prompted/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,591 copying lm_eval/tasks/global_piqa/prompted/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,594 copying lm_eval/tasks/global_piqa/prompted/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,596 copying lm_eval/tasks/global_piqa/prompted/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,598 copying lm_eval/tasks/global_piqa/prompted/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,600 copying lm_eval/tasks/global_piqa/prompted/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,602 copying lm_eval/tasks/global_piqa/prompted/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,605 copying lm_eval/tasks/global_piqa/prompted/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,607 copying lm_eval/tasks/global_piqa/prompted/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,609 copying lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,611 copying lm_eval/tasks/global_piqa/prompted/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,613 copying lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,615 copying lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,617 copying lm_eval/tasks/global_piqa/prompted/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,619 copying lm_eval/tasks/global_piqa/prompted/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,621 copying lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,624 copying lm_eval/tasks/global_piqa/prompted/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,626 copying lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,628 copying lm_eval/tasks/global_piqa/prompted/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,630 copying lm_eval/tasks/global_piqa/prompted/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,633 copying lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,635 copying lm_eval/tasks/global_piqa/prompted/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,637 copying lm_eval/tasks/global_piqa/prompted/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:23,639 copying lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,642 copying lm_eval/tasks/global_piqa/completions/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,644 copying lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,646 copying lm_eval/tasks/global_piqa/completions/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,648 copying lm_eval/tasks/global_piqa/completions/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,651 copying lm_eval/tasks/global_piqa/completions/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,653 copying lm_eval/tasks/global_piqa/completions/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,655 copying lm_eval/tasks/global_piqa/completions/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,657 copying lm_eval/tasks/global_piqa/completions/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,660 copying lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,662 copying lm_eval/tasks/global_piqa/completions/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,665 copying lm_eval/tasks/global_piqa/completions/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,667 copying lm_eval/tasks/global_piqa/completions/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,669 copying lm_eval/tasks/global_piqa/completions/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,672 copying lm_eval/tasks/global_piqa/completions/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,674 copying lm_eval/tasks/global_piqa/completions/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,676 copying lm_eval/tasks/global_piqa/completions/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,679 copying lm_eval/tasks/global_piqa/completions/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,681 copying lm_eval/tasks/global_piqa/completions/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,683 copying lm_eval/tasks/global_piqa/completions/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,685 copying lm_eval/tasks/global_piqa/completions/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,687 copying lm_eval/tasks/global_piqa/completions/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,690 copying lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,692 copying lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,694 copying lm_eval/tasks/global_piqa/completions/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,696 copying lm_eval/tasks/global_piqa/completions/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,699 copying lm_eval/tasks/global_piqa/completions/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,701 copying lm_eval/tasks/global_piqa/completions/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,703 copying lm_eval/tasks/global_piqa/completions/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,706 copying lm_eval/tasks/global_piqa/completions/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,708 copying lm_eval/tasks/global_piqa/completions/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,710 copying lm_eval/tasks/global_piqa/completions/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,712 copying lm_eval/tasks/global_piqa/completions/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,714 copying lm_eval/tasks/global_piqa/completions/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,717 copying lm_eval/tasks/global_piqa/completions/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,719 copying lm_eval/tasks/global_piqa/completions/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,721 copying lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,723 copying lm_eval/tasks/global_piqa/completions/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,725 copying lm_eval/tasks/global_piqa/completions/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,727 copying lm_eval/tasks/global_piqa/completions/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,730 copying lm_eval/tasks/global_piqa/completions/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,732 copying lm_eval/tasks/global_piqa/completions/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,734 copying lm_eval/tasks/global_piqa/completions/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,736 copying lm_eval/tasks/global_piqa/completions/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,738 copying lm_eval/tasks/global_piqa/completions/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,740 copying lm_eval/tasks/global_piqa/completions/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,742 copying lm_eval/tasks/global_piqa/completions/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,745 copying lm_eval/tasks/global_piqa/completions/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,747 copying lm_eval/tasks/global_piqa/completions/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,749 copying lm_eval/tasks/global_piqa/completions/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,751 copying lm_eval/tasks/global_piqa/completions/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,753 copying lm_eval/tasks/global_piqa/completions/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,755 copying lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,757 copying lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,760 copying lm_eval/tasks/global_piqa/completions/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,762 copying lm_eval/tasks/global_piqa/completions/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,764 copying lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,766 copying lm_eval/tasks/global_piqa/completions/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,769 copying lm_eval/tasks/global_piqa/completions/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,771 copying lm_eval/tasks/global_piqa/completions/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,773 copying lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,775 copying lm_eval/tasks/global_piqa/completions/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,777 copying lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,779 copying lm_eval/tasks/global_piqa/completions/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,781 copying lm_eval/tasks/global_piqa/completions/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,784 copying lm_eval/tasks/global_piqa/completions/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,786 copying lm_eval/tasks/global_piqa/completions/_global_piqa.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,789 copying lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,791 copying lm_eval/tasks/global_piqa/completions/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,793 copying lm_eval/tasks/global_piqa/completions/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,796 copying lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,798 copying lm_eval/tasks/global_piqa/completions/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,800 copying lm_eval/tasks/global_piqa/completions/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,802 copying lm_eval/tasks/global_piqa/completions/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,805 copying lm_eval/tasks/global_piqa/completions/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,807 copying lm_eval/tasks/global_piqa/completions/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,809 copying lm_eval/tasks/global_piqa/completions/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,811 copying lm_eval/tasks/global_piqa/completions/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,813 copying lm_eval/tasks/global_piqa/completions/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,815 copying lm_eval/tasks/global_piqa/completions/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,817 copying lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,820 copying lm_eval/tasks/global_piqa/completions/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,822 copying lm_eval/tasks/global_piqa/completions/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,824 copying lm_eval/tasks/global_piqa/completions/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,826 copying lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,829 copying lm_eval/tasks/global_piqa/completions/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,831 copying lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,833 copying lm_eval/tasks/global_piqa/completions/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,835 copying lm_eval/tasks/global_piqa/completions/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,838 copying lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,840 copying lm_eval/tasks/global_piqa/completions/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,842 copying lm_eval/tasks/global_piqa/completions/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,844 copying lm_eval/tasks/global_piqa/completions/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,847 copying lm_eval/tasks/global_piqa/completions/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,849 copying lm_eval/tasks/global_piqa/completions/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,852 copying lm_eval/tasks/global_piqa/completions/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,854 copying lm_eval/tasks/global_piqa/completions/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,856 copying lm_eval/tasks/global_piqa/completions/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,858 copying lm_eval/tasks/global_piqa/completions/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,861 copying lm_eval/tasks/global_piqa/completions/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,863 copying lm_eval/tasks/global_piqa/completions/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,865 copying lm_eval/tasks/global_piqa/completions/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,868 copying lm_eval/tasks/global_piqa/completions/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,870 copying lm_eval/tasks/global_piqa/completions/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,873 copying lm_eval/tasks/global_piqa/completions/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,875 copying lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,877 copying lm_eval/tasks/global_piqa/completions/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,880 copying lm_eval/tasks/global_piqa/completions/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,882 copying lm_eval/tasks/global_piqa/completions/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,884 copying lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,887 copying lm_eval/tasks/global_piqa/completions/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,889 copying lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,891 copying lm_eval/tasks/global_piqa/completions/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,893 copying lm_eval/tasks/global_piqa/completions/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,896 copying lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,898 copying lm_eval/tasks/global_piqa/completions/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,900 copying lm_eval/tasks/global_piqa/completions/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:23,902 creating build/lib/lm_eval/tasks/anli 2025-11-27T00:43:23,904 copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli 2025-11-27T00:43:23,906 copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli 2025-11-27T00:43:23,908 copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli 2025-11-27T00:43:23,911 copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,913 copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,915 copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,917 copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,920 copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,922 copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,925 copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,928 copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,931 copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,933 copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,935 copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,938 copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:23,940 copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench 2025-11-27T00:43:23,943 copying lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:43:23,945 copying lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:43:23,948 copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,950 copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,952 copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,954 copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,957 copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,959 copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,961 copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:23,963 creating build/lib/lm_eval/tasks/bangla 2025-11-27T00:43:23,964 copying lm_eval/tasks/bangla/bangla_mmlu_test.yaml -> build/lib/lm_eval/tasks/bangla 2025-11-27T00:43:23,967 copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,969 copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,971 copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,973 copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,976 copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,978 copying lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,981 copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,983 copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:23,985 creating build/lib/lm_eval/tasks/pile_10k 2025-11-27T00:43:23,987 copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k 2025-11-27T00:43:23,989 copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde 2025-11-27T00:43:23,991 creating build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:23,993 copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:23,995 copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:23,998 copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:24,000 copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:24,003 copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:24,006 copying lm_eval/tasks/meqsum/meqsum.yaml -> build/lib/lm_eval/tasks/meqsum 2025-11-27T00:43:24,008 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,011 copying lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,013 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,015 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,018 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,020 copying lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,022 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,024 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,027 copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,029 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,032 copying lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,034 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,036 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,039 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,041 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,043 copying lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,045 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,048 copying lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,050 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,052 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,055 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,057 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,059 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,061 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,064 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,066 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,069 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,071 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,073 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,076 copying lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,078 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,080 copying lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,083 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,085 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,088 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,090 copying lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,093 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,095 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,097 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,100 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,102 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,105 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,107 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,110 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,112 copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,114 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:24,117 copying lm_eval/tasks/chartqa/chartqa.yaml -> build/lib/lm_eval/tasks/chartqa 2025-11-27T00:43:24,119 copying lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/lib/lm_eval/tasks/chartqa 2025-11-27T00:43:24,121 copying lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/lib/lm_eval/tasks/chartqa 2025-11-27T00:43:24,123 creating build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,124 copying lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,127 copying lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,129 copying lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,132 copying lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,134 copying lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,136 copying lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,138 copying lm_eval/tasks/zhoblimp/left_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,141 copying lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,143 copying lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,146 copying lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,148 copying lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,150 copying lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,153 copying lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,155 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,157 copying lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,160 copying lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,162 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,165 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,167 copying lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,169 copying lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,172 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,174 copying lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,176 copying lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,178 copying lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,180 copying lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,182 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,184 copying lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,186 copying lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,188 copying lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,191 copying lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,193 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,195 copying lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,197 copying lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,199 copying lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,201 copying lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,203 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,206 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,208 copying lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,210 copying lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,212 copying lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,215 copying lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,217 copying lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,219 copying lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,221 copying lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,223 copying lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,226 copying lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,228 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,230 copying lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,232 copying lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,235 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,237 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,239 copying lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,241 copying lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,244 copying lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,246 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,249 copying lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,251 copying lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,253 copying lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,255 copying lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,257 copying lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,260 copying lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,262 copying lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,264 copying lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,266 copying lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,269 copying lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,271 copying lm_eval/tasks/zhoblimp/you_yige.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,273 copying lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,276 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,278 copying lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,280 copying lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,282 copying lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,284 copying lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,287 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,289 copying lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,292 copying lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,294 copying lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,296 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,299 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,301 copying lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,303 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,306 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,308 copying lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,310 copying lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,312 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,315 copying lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,317 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,319 copying lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,322 copying lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,324 copying lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,327 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,329 copying lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,331 copying lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,333 copying lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,335 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,337 copying lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,340 copying lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,342 copying lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,344 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,346 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,349 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,351 copying lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,353 copying lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,355 copying lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,357 copying lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,360 copying lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,362 copying lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,364 copying lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,366 copying lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,368 copying lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,370 copying lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,373 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,375 copying lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,377 copying lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,379 copying lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,381 copying lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,383 copying lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,386 copying lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,388 copying lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,390 copying lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:24,392 copying lm_eval/tasks/moral_stories/moral_stories.yaml -> build/lib/lm_eval/tasks/moral_stories 2025-11-27T00:43:24,395 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,397 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,399 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,402 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,404 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,406 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,409 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,411 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,415 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,417 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,419 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,422 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,424 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,427 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,429 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,432 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,434 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,437 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,439 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,441 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,444 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,446 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,449 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,451 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,453 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,456 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,458 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,461 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,464 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,466 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,468 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,471 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,473 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,476 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,478 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,480 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,482 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,485 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,487 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,490 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,492 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,494 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,497 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,499 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,502 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,504 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,507 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,509 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,512 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,514 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,516 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,518 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,521 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,523 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,525 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,528 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,530 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,532 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,535 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,537 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,539 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,541 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:24,544 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,546 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,548 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,550 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,553 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,555 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,557 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,559 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,561 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,563 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,566 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,568 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,570 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,572 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,575 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:24,577 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,580 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,583 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,585 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,588 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,591 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,594 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,597 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,599 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,602 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,605 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,608 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,611 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,614 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,616 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,619 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,622 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,624 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,626 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,629 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,632 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,635 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,638 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,641 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,643 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,646 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,649 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,651 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,654 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,656 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,660 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,665 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,670 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,674 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,680 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,685 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,689 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,692 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,694 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,696 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,699 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,702 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,704 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,707 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,709 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,712 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,715 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,717 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,720 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,723 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,726 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,728 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,731 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,734 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,737 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,739 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,742 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,744 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,747 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,750 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,753 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,756 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:24,759 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,762 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,764 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,767 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,769 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,771 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,773 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,775 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,778 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,780 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,783 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,785 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,787 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,790 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,792 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,795 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,797 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,800 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,802 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,804 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,806 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,809 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,811 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,813 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,816 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,819 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,821 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,823 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,825 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,828 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,830 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,832 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,834 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,837 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,839 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,841 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,844 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,846 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,849 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,851 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,853 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,856 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,858 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,860 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,863 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,865 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,868 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,870 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,872 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,875 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,877 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,880 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,882 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,884 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,887 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,889 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,891 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,894 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,896 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,898 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,900 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,903 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:24,905 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,907 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,910 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,912 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,915 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,917 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,919 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,922 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,924 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,926 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,929 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,932 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,934 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,936 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,939 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,941 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,943 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,946 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,949 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,952 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,955 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,958 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,961 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,964 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,967 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,970 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,972 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,975 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,978 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,981 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,984 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,987 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,991 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,994 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:24,998 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,001 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,004 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,007 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,010 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,013 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,016 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,019 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,022 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,025 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,028 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,031 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,034 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,037 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,040 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,043 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,047 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,049 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,052 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,054 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,056 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,059 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,062 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,064 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,066 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,069 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,071 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,074 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:25,076 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,077 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,079 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,081 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,083 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,086 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,088 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,090 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,092 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,095 copying lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,097 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,099 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,101 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,103 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,105 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,107 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,110 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,112 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,114 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,116 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,118 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,120 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,123 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,125 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,127 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,129 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,132 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,135 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,137 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,139 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,141 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,143 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,145 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,148 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,150 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,152 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,154 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,157 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,159 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,161 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,163 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,165 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,167 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,169 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,171 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,174 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,176 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,178 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,180 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,182 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,185 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,187 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,190 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,192 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,195 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,198 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,200 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,202 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,205 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,208 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,213 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,217 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,220 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:25,223 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,226 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,233 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,241 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,249 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,257 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,259 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,261 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,264 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,267 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,271 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,276 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,281 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,287 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,290 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,293 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,296 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,300 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,303 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,305 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,307 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,309 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,312 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,314 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,317 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,319 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,321 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,323 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,326 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,328 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,330 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,332 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,334 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,336 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,338 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,341 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,343 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,345 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,347 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,349 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,351 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,353 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,355 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,358 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,360 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,363 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,365 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,367 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,370 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,372 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,375 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,378 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,382 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,385 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,387 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,389 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,391 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,394 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,396 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,398 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,400 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,402 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,404 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:25,407 copying lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:43:25,409 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,412 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,414 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,417 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,420 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,423 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,426 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,429 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,431 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,434 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,437 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,439 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,442 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,445 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,447 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,450 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,453 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,456 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,458 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,460 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,462 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,465 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,467 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,470 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,473 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,475 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,478 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,480 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,483 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,486 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,489 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,491 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,494 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,497 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,500 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,502 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,505 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,508 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,511 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,514 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,516 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,519 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,521 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,524 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,527 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,530 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,533 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,535 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,539 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,541 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,544 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,546 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,549 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,552 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,554 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,557 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,559 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,562 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,565 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,567 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,571 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,573 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:25,576 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,578 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,581 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,583 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,585 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,588 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,590 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,593 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,595 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,598 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,600 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,603 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,605 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,607 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,610 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,612 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,614 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,616 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,619 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,621 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,624 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,626 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,628 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,631 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,634 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,636 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,638 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,641 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,643 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,645 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,648 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,650 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,653 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,655 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,658 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,660 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,663 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,665 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,668 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,670 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,673 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,675 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,678 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,680 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,682 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,684 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,687 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,689 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,691 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,694 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,696 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,698 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,701 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,703 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,706 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,708 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,710 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,713 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,715 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,717 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,720 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,722 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:25,724 creating build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2025-11-27T00:43:25,726 copying lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2025-11-27T00:43:25,728 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,731 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,734 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,736 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,739 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,741 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,744 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,746 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,748 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,751 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,753 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,755 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,758 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,760 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,762 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,764 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,767 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,769 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,771 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,774 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,776 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,779 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,781 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,783 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,786 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,789 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,791 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,793 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,796 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,798 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,800 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,802 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,804 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,807 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,809 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,812 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,814 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,816 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,819 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,821 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,823 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,825 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,828 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,830 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,832 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,835 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,837 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,840 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,842 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,844 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,847 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,849 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,852 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,854 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,856 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,859 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,861 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,863 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,865 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,868 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,870 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,873 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:25,875 copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,877 copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,879 copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,882 copying lm_eval/tasks/kobest/_kobest.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,884 copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,886 copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:25,889 copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex 2025-11-27T00:43:25,891 copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex 2025-11-27T00:43:25,893 copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex 2025-11-27T00:43:25,895 creating build/lib/lm_eval/tasks/babi 2025-11-27T00:43:25,896 copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi 2025-11-27T00:43:25,899 copying lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,901 copying lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,904 copying lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,906 copying lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,908 copying lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,910 copying lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,912 copying lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,915 copying lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,917 copying lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,919 copying lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,921 copying lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,924 copying lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,926 copying lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,928 copying lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,930 copying lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,933 copying lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,935 copying lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,937 copying lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,939 copying lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,941 copying lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,944 copying lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,946 copying lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,948 copying lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,950 copying lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,952 copying lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,954 copying lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,956 copying lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,958 copying lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,961 copying lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,963 copying lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,966 copying lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,968 copying lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,970 copying lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,973 copying lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,974 copying lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,977 copying lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,979 copying lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,981 copying lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,983 copying lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,985 copying lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,988 copying lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,990 copying lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,992 copying lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,994 copying lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,996 copying lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:25,999 copying lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:26,001 copying lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:26,003 copying lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:26,005 copying lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:26,008 copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,010 copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,012 copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,014 copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,017 copying lm_eval/tasks/basque_bench/paws_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,019 copying lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,021 copying lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,023 copying lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,025 copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:26,028 copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,030 copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,032 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,034 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,036 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,038 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,040 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,042 copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,045 copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,047 copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,049 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,051 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,053 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,056 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,058 copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,060 copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,062 copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:26,064 creating build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,065 copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,068 copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,070 copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,072 copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,075 copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,077 copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,079 copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,081 copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,083 copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,086 copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,088 copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:26,091 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:43:26,093 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:43:26,095 copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,097 copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,099 copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,102 copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,104 copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,106 copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,108 copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,110 copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,112 copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,115 copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,117 copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,119 copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,121 copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,123 copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,126 copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,128 copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,130 copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,132 copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,134 copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,137 copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,139 copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,142 copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,144 copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,146 copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,149 copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,151 copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,153 copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,155 copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,158 copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,160 copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,162 copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,165 copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,167 copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,169 copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,171 copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,173 copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,176 copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,178 copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,180 copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,182 copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,184 copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,187 copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,189 copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,191 copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,193 copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,196 copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,198 copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,200 copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,205 copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,207 copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,209 copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,212 copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,214 copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,221 copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,224 copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,226 copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,228 copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,230 copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,232 copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,234 copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,237 copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,239 copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,241 copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,243 copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,245 copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,248 copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,250 copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,252 copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:26,255 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,257 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,259 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,261 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,263 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,265 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,267 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,269 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,272 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,274 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,276 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,278 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,280 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,282 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,284 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:26,286 creating build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,288 copying lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,290 copying lm_eval/tasks/longbench2/longbench2_code.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,292 copying lm_eval/tasks/longbench2/many_shot.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,294 copying lm_eval/tasks/longbench2/news_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,296 copying lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,299 copying lm_eval/tasks/longbench2/user_guide.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,301 copying lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,303 copying lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,305 copying lm_eval/tasks/longbench2/legal_single.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,307 copying lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,309 copying lm_eval/tasks/longbench2/graph.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,312 copying lm_eval/tasks/longbench2/academic_single.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,314 copying lm_eval/tasks/longbench2/translate.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,316 copying lm_eval/tasks/longbench2/event_order.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,318 copying lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,320 copying lm_eval/tasks/longbench2/_longbench2.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,323 copying lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,325 copying lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,327 copying lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,329 copying lm_eval/tasks/longbench2/table.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,331 copying lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,333 copying lm_eval/tasks/longbench2/detective.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,335 copying lm_eval/tasks/longbench2/dialogue_history.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,338 copying lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,340 copying lm_eval/tasks/longbench2/legal_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,342 copying lm_eval/tasks/longbench2/agent_history.yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:26,344 creating build/lib/lm_eval/tasks/lambada 2025-11-27T00:43:26,345 copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada 2025-11-27T00:43:26,348 copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada 2025-11-27T00:43:26,350 copying lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,353 copying lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,355 copying lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,357 copying lm_eval/tasks/bbq/bbq_generate.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,360 copying lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,362 copying lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:26,365 copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,367 copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,369 copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,371 copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,373 copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,375 copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,378 copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,380 copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,382 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,385 copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,387 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,389 copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,391 copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,393 copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,396 copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,398 copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,400 copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,402 copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,405 copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,407 copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,409 copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,411 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,413 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,415 copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,417 copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,419 copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:26,421 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,423 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,426 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,428 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,430 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,432 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,434 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,437 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,439 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,441 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,443 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,445 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,447 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,450 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,452 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,454 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,456 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,458 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,461 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,463 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,465 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,467 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,469 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,471 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,473 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,475 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,478 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,480 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,482 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,484 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:26,486 copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,489 copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,491 copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,493 copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,495 copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,498 copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,500 copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,502 copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,504 copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,506 copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,509 copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,511 copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,513 copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,515 copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,517 copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,520 copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,522 copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,524 copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,527 copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,529 copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,531 copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,533 copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,535 copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,537 copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,539 copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,541 copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,543 copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,546 copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,548 copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,550 copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,552 copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:26,554 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,557 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,559 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,561 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,563 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,565 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,568 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,570 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,572 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,575 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,577 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,579 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,581 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,584 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,586 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,588 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,590 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,593 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,595 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,597 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,599 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,601 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,603 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,605 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,608 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,610 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,612 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,614 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,617 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,620 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,622 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,624 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,626 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,628 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,630 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,633 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,635 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,637 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,639 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,642 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,644 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,646 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,649 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,651 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,653 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,655 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,657 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,659 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,661 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,664 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,666 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,668 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,670 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,672 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,675 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,677 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,679 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,682 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,684 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,686 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,689 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,691 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:26,693 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,696 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,698 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,700 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,702 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,704 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,707 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,709 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,711 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,713 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,715 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,717 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,719 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,721 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,724 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,726 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,728 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,730 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,733 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,735 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,737 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,739 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,741 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,744 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,746 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,748 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,750 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,752 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,755 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,757 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,759 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,762 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,764 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,766 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:26,768 creating build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,770 copying lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,772 copying lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,774 copying lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,777 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,779 copying lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,781 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,783 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,785 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,787 copying lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,790 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,792 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,794 copying lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,796 copying lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,798 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,800 copying lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,803 copying lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,805 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,807 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,809 copying lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,812 copying lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,815 copying lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,817 copying lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,819 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,821 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,824 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,826 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,829 copying lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,831 copying lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,833 copying lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,835 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,838 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,840 copying lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,842 copying lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,845 copying lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,847 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,849 copying lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,852 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,854 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,856 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,859 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,861 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,863 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,865 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,867 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,870 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,872 copying lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,874 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,876 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,879 copying lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,881 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,883 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,886 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,888 copying lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,890 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,892 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,895 copying lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,897 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,899 copying lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,901 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,904 copying lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,906 copying lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,908 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,911 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,913 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,915 copying lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,917 copying lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,919 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,922 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,924 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,926 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,928 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,930 copying lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,932 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,934 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,936 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,939 copying lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,941 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,943 copying lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,945 copying lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,947 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,949 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,951 copying lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,954 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,956 copying lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,958 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:26,960 copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks 2025-11-27T00:43:26,965 copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande 2025-11-27T00:43:26,968 copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:43:26,971 copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp 2025-11-27T00:43:26,973 copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze 2025-11-27T00:43:26,975 copying lm_eval/tasks/multiblimp/README.md -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:43:26,978 copying lm_eval/tasks/multiblimp/_template_yaml -> build/lib/lm_eval/tasks/multiblimp 2025-11-27T00:43:26,980 copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa 2025-11-27T00:43:26,983 copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:43:26,987 copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench 2025-11-27T00:43:26,989 copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:43:26,992 copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro 2025-11-27T00:43:26,995 copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open 2025-11-27T00:43:26,998 copying lm_eval/tasks/arab_culture/README.md -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:43:27,000 copying lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/lib/lm_eval/tasks/arab_culture 2025-11-27T00:43:27,003 copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli 2025-11-27T00:43:27,007 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:27,011 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:27,013 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:27,016 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:27,019 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:27,022 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:27,025 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:27,028 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:27,030 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:27,034 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:27,037 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:27,040 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:27,043 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:27,045 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:27,048 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:27,050 copying lm_eval/tasks/afrobench/README.md -> build/lib/lm_eval/tasks/afrobench 2025-11-27T00:43:27,053 copying lm_eval/tasks/afrobench/nollysenti/README.md -> build/lib/lm_eval/tasks/afrobench/nollysenti 2025-11-27T00:43:27,055 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:27,058 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:27,061 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:27,064 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:27,067 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:27,070 copying lm_eval/tasks/afrobench/naijarc/README.md -> build/lib/lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:27,073 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:27,075 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:27,077 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:27,079 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:27,081 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:27,083 copying lm_eval/tasks/afrobench/ntrex/README.md -> build/lib/lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:27,086 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:27,088 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:27,090 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:27,092 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:27,095 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:27,097 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:27,099 copying lm_eval/tasks/afrobench/mafand/README.md -> build/lib/lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:27,103 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:27,105 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:27,108 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:27,111 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:27,114 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:27,117 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:27,120 copying lm_eval/tasks/afrobench/belebele/README.md -> build/lib/lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:27,123 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:27,125 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:27,127 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:27,130 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:27,132 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:27,134 copying lm_eval/tasks/afrobench/injongointent/README.md -> build/lib/lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:27,137 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:27,140 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:27,143 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:27,146 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:27,148 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:27,151 copying lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:27,154 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:27,156 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:27,158 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:27,160 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:27,162 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:27,164 creating build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:27,165 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:27,167 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:27,170 copying lm_eval/tasks/afrobench/adr/README.md -> build/lib/lm_eval/tasks/afrobench/adr 2025-11-27T00:43:27,173 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:27,175 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:27,177 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:27,179 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:27,181 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:27,184 copying lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:27,188 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:27,191 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:27,194 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:27,197 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:27,200 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:27,203 copying lm_eval/tasks/afrobench/salt/README.md -> build/lib/lm_eval/tasks/afrobench/salt 2025-11-27T00:43:27,206 copying lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:27,208 copying lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:27,210 copying lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:27,213 copying lm_eval/tasks/afrobench/afrisenti/README.md -> build/lib/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:27,216 copying lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:27,219 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:27,222 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:27,225 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:27,229 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:27,232 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:27,236 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:27,240 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:27,243 copying lm_eval/tasks/afrobench/masakhaner/README.md -> build/lib/lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:27,247 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:27,250 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:27,253 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:27,256 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:27,259 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:27,261 copying lm_eval/tasks/afrobench/masakhapos/README.md -> build/lib/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:27,265 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:27,268 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:27,271 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:27,274 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:27,277 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:27,279 copying lm_eval/tasks/afrobench/flores/README.md -> build/lib/lm_eval/tasks/afrobench/flores 2025-11-27T00:43:27,283 copying lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3 2025-11-27T00:43:27,285 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:27,287 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:27,290 copying lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1 2025-11-27T00:43:27,292 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:27,295 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:27,297 copying lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2 2025-11-27T00:43:27,300 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:27,302 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:27,305 copying lm_eval/tasks/afrobench/afriqa/README.md -> build/lib/lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:27,308 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:27,311 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:27,315 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:27,318 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:27,321 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:27,323 copying lm_eval/tasks/afrobench/xlsum/README.md -> build/lib/lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:27,327 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:27,330 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:27,332 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:27,335 copying lm_eval/tasks/afrobench/masakhanews/README.md -> build/lib/lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:27,339 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:27,342 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:27,345 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:27,348 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:27,351 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:27,353 copying lm_eval/tasks/afrobench/sib/README.md -> build/lib/lm_eval/tasks/afrobench/sib 2025-11-27T00:43:27,357 copying lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:27,360 copying lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:27,363 copying lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:27,366 copying lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:27,369 copying lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:27,372 copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:27,375 copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x 2025-11-27T00:43:27,378 copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:27,383 copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:27,386 copying lm_eval/tasks/include/README.md -> build/lib/lm_eval/tasks/include 2025-11-27T00:43:27,389 copying lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:27,392 copying lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:27,396 copying lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/lib/lm_eval/tasks/include/default/Basque 2025-11-27T00:43:27,398 copying lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:27,402 copying lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/lib/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:27,405 copying lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:27,408 copying lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/lib/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:27,410 copying lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:27,414 copying lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:27,417 copying lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:27,419 copying lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:27,422 copying lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:27,425 copying lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:27,428 copying lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/lib/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:27,432 copying lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:27,435 copying lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:27,437 copying lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/lib/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:27,440 copying lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:27,444 copying lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:27,447 copying lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:27,449 copying lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:27,452 copying lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:27,456 copying lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:27,458 copying lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/lib/lm_eval/tasks/include/default/Korean 2025-11-27T00:43:27,461 copying lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:27,464 copying lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:27,468 copying lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:27,470 copying lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:27,473 copying lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:27,476 copying lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:27,479 copying lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:27,482 copying lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:27,485 copying lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:27,489 copying lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:27,492 copying lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/lib/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:27,495 copying lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:27,497 copying lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:27,501 copying lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:27,504 copying lm_eval/tasks/include/default/German/_german_template_yaml -> build/lib/lm_eval/tasks/include/default/German 2025-11-27T00:43:27,506 copying lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:27,509 copying lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:27,512 copying lm_eval/tasks/include/default/French/_french_template_yaml -> build/lib/lm_eval/tasks/include/default/French 2025-11-27T00:43:27,515 copying lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:27,518 copying lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/lib/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:27,522 copying lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:27,525 copying lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:27,528 copying lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:27,532 copying lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:27,535 copying lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:27,538 copying lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:27,541 copying lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:27,544 copying lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:27,547 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:27,551 copying lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:27,554 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:27,557 copying lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:27,560 copying lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:27,563 copying lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:27,566 copying lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:27,570 copying lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:27,573 copying lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:27,575 copying lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:27,578 copying lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:27,581 copying lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:27,583 copying lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:27,587 copying lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:27,589 copying lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:27,592 copying lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:27,596 copying lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:27,599 copying lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:27,602 copying lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:27,605 copying lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:27,607 copying lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:27,610 copying lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:27,613 copying lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:27,617 copying lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:27,619 copying lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:27,622 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:27,626 copying lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:27,629 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:27,632 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:27,635 copying lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:27,638 copying lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:27,641 copying lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:27,644 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:27,646 copying lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:27,649 copying lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:27,652 copying lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:27,656 copying lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:27,658 copying lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:27,661 copying lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:27,664 copying lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:27,668 copying lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:27,670 copying lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:27,674 copying lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:27,677 copying lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:27,679 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:27,682 copying lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:27,685 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:27,689 copying lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:27,692 copying lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:27,696 copying lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:27,699 copying lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:27,702 copying lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:27,705 copying lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:27,708 copying lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:27,712 copying lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:27,714 copying lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:27,718 copying lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:27,720 copying lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:27,723 copying lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:27,726 copying lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:27,730 copying lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:27,733 copying lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:27,736 copying lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:27,740 copying lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:27,742 copying lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:27,745 copying lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:27,748 copying lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:27,751 copying lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:27,754 copying lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:27,757 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:27,761 copying lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:27,763 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:27,766 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:27,770 copying lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:27,772 copying lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:27,775 copying lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:27,779 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:27,781 copying lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:27,785 copying lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:27,787 copying lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:27,790 copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:27,793 copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa 2025-11-27T00:43:27,795 copying lm_eval/tasks/careqa/README.md -> build/lib/lm_eval/tasks/careqa 2025-11-27T00:43:27,799 copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile 2025-11-27T00:43:27,802 copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa 2025-11-27T00:43:27,805 copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:27,809 copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:27,812 copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:27,815 copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative 2025-11-27T00:43:27,819 copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:27,822 copying lm_eval/tasks/mbpp/README.md -> build/lib/lm_eval/tasks/mbpp 2025-11-27T00:43:27,826 copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:27,828 copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa 2025-11-27T00:43:27,832 copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa 2025-11-27T00:43:27,834 copying lm_eval/tasks/jsonschema_bench/README.md -> build/lib/lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:27,838 copying lm_eval/tasks/longbench/README.md -> build/lib/lm_eval/tasks/longbench 2025-11-27T00:43:27,842 copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia 2025-11-27T00:43:27,845 copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:27,848 copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:27,850 copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:27,854 copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams 2025-11-27T00:43:27,856 copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench 2025-11-27T00:43:27,859 copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:27,861 copying lm_eval/tasks/graphwalks/README.md -> build/lib/lm_eval/tasks/graphwalks 2025-11-27T00:43:27,864 copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench 2025-11-27T00:43:27,869 copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:27,871 copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:27,873 copying lm_eval/tasks/mimic_repsum/README.md -> build/lib/lm_eval/tasks/mimic_repsum 2025-11-27T00:43:27,877 copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual 2025-11-27T00:43:27,880 copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:27,882 copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation 2025-11-27T00:43:27,885 copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:27,888 copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele 2025-11-27T00:43:27,891 copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:43:27,893 copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:43:27,895 copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm 2025-11-27T00:43:27,899 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:27,901 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:27,904 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:27,906 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:27,908 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:27,910 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:27,913 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:27,915 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:27,917 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:27,919 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:27,922 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:27,924 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:27,927 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:27,929 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:27,931 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:27,934 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:27,936 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:27,938 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:27,941 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:27,943 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:27,945 copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag 2025-11-27T00:43:27,949 copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:27,951 copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:27,953 copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt 2025-11-27T00:43:27,957 copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost 2025-11-27T00:43:27,960 copying lm_eval/tasks/groundcocoa/README.md -> build/lib/lm_eval/tasks/groundcocoa 2025-11-27T00:43:27,963 copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze 2025-11-27T00:43:27,966 copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu 2025-11-27T00:43:27,968 copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:27,970 copying lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:27,972 copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:27,974 copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:27,977 copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:27,979 copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly 2025-11-27T00:43:27,982 copying lm_eval/tasks/c4/README.md -> build/lib/lm_eval/tasks/c4 2025-11-27T00:43:27,985 copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:27,987 copying lm_eval/tasks/kormedmcqa/_template_yaml -> build/lib/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:27,990 copying lm_eval/tasks/humaneval_infilling/README.md -> build/lib/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:27,993 copying lm_eval/tasks/mastermind/README.md -> build/lib/lm_eval/tasks/mastermind 2025-11-27T00:43:27,995 copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:27,997 copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams 2025-11-27T00:43:28,000 copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop 2025-11-27T00:43:28,003 copying lm_eval/tasks/bhs/README.md -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:28,005 copying lm_eval/tasks/bhs/_template_yaml -> build/lib/lm_eval/tasks/bhs 2025-11-27T00:43:28,008 copying lm_eval/tasks/discrim_eval/README.md -> build/lib/lm_eval/tasks/discrim_eval 2025-11-27T00:43:28,011 copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda 2025-11-27T00:43:28,015 copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh 2025-11-27T00:43:28,018 copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:28,021 copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:28,024 copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:28,026 copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:28,028 copying lm_eval/tasks/egymmlu/README.md -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:28,031 copying lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/lib/lm_eval/tasks/egymmlu 2025-11-27T00:43:28,034 copying lm_eval/tasks/mmlu_prox/README.md -> build/lib/lm_eval/tasks/mmlu_prox 2025-11-27T00:43:28,039 copying lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:28,041 copying lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:28,044 copying lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:28,047 copying lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:28,050 copying lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:28,053 copying lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:28,055 copying lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:28,059 copying lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:28,061 copying lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:28,064 copying lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:28,066 copying lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:28,069 copying lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:28,071 copying lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:28,074 copying lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:28,076 copying lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:28,079 copying lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:28,081 copying lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:28,084 copying lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:28,086 copying lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:28,089 copying lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:28,092 copying lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:28,094 copying lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:28,097 copying lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:28,100 copying lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:28,102 copying lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:28,105 copying lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:28,107 copying lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:28,110 copying lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:28,113 copying lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:28,115 copying lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:28,118 copying lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:28,121 copying lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:28,123 copying lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:28,125 copying lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:28,128 copying lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:28,130 copying lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:28,133 copying lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:28,136 copying lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:28,139 copying lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:28,142 copying lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:28,144 copying lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:28,147 copying lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:28,150 copying lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:28,153 copying lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:28,156 copying lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:28,158 copying lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:28,160 copying lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/template 2025-11-27T00:43:28,163 copying lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:28,165 copying lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:28,169 copying lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:28,171 copying lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:28,174 copying lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:28,176 copying lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:28,179 copying lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:28,182 copying lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:28,184 copying lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:28,187 copying lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:28,190 copying lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:28,192 copying lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:28,195 copying lm_eval/tasks/lm_syneval/README.md -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:28,198 copying lm_eval/tasks/lm_syneval/_template_yaml -> build/lib/lm_eval/tasks/lm_syneval 2025-11-27T00:43:28,200 copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:28,203 creating build/lib/lm_eval/tasks/model_written_evals/winogenerated 2025-11-27T00:43:28,204 copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/lib/lm_eval/tasks/model_written_evals/winogenerated 2025-11-27T00:43:28,207 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:28,210 copying lm_eval/tasks/ruler/README.md -> build/lib/lm_eval/tasks/ruler 2025-11-27T00:43:28,218 copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2025-11-27T00:43:28,231 copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco 2025-11-27T00:43:28,233 copying lm_eval/tasks/cnn_dailymail/README.md -> build/lib/lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:28,237 copying lm_eval/tasks/winogender/README.md -> build/lib/lm_eval/tasks/winogender 2025-11-27T00:43:28,240 copying lm_eval/tasks/olaph/README.md -> build/lib/lm_eval/tasks/olaph 2025-11-27T00:43:28,244 copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score 2025-11-27T00:43:28,247 copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score 2025-11-27T00:43:28,250 copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score 2025-11-27T00:43:28,253 copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:28,257 copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:28,260 copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:28,263 copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math 2025-11-27T00:43:28,266 copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze 2025-11-27T00:43:28,268 copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus 2025-11-27T00:43:28,271 copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus 2025-11-27T00:43:28,273 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:28,277 copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval 2025-11-27T00:43:28,282 copying lm_eval/tasks/mmlu-redux-spanish/README.md -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:28,284 copying lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:28,287 copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc 2025-11-27T00:43:28,289 copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion 2025-11-27T00:43:28,292 copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:28,294 copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:28,297 copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre 2025-11-27T00:43:28,300 copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:28,302 copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue 2025-11-27T00:43:28,305 copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa 2025-11-27T00:43:28,308 copying lm_eval/tasks/turblimp/README.md -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:28,310 copying lm_eval/tasks/turblimp/_template_yaml -> build/lib/lm_eval/tasks/turblimp 2025-11-27T00:43:28,312 copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext 2025-11-27T00:43:28,315 copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:28,317 copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae 2025-11-27T00:43:28,320 copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue 2025-11-27T00:43:28,323 copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa 2025-11-27T00:43:28,325 copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench 2025-11-27T00:43:28,330 copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:28,332 copying lm_eval/tasks/click/README.md -> build/lib/lm_eval/tasks/click 2025-11-27T00:43:28,334 copying lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/lib/lm_eval/tasks/click/click_lang 2025-11-27T00:43:28,338 copying lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/lib/lm_eval/tasks/click/click_cul 2025-11-27T00:43:28,340 copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq 2025-11-27T00:43:28,343 copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen 2025-11-27T00:43:28,346 copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2 2025-11-27T00:43:28,349 copying lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:28,352 copying lm_eval/tasks/darijammlu/README.md -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:28,356 copying lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/lib/lm_eval/tasks/darijammlu 2025-11-27T00:43:28,358 copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:28,363 copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm 2025-11-27T00:43:28,366 copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm 2025-11-27T00:43:28,369 copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:28,371 copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:28,373 copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:28,375 copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2025-11-27T00:43:28,389 copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv 2025-11-27T00:43:28,391 copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa 2025-11-27T00:43:28,394 copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic 2025-11-27T00:43:28,396 copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id 2025-11-27T00:43:28,399 copying lm_eval/tasks/arab_culture_completion/README.md -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:28,402 copying lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:28,406 copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:28,409 copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli 2025-11-27T00:43:28,412 copying lm_eval/tasks/noreval/README.md -> build/lib/lm_eval/tasks/noreval 2025-11-27T00:43:28,415 copying lm_eval/tasks/noreval/noreval.jpg -> build/lib/lm_eval/tasks/noreval 2025-11-27T00:43:28,428 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2025-11-27T00:43:28,433 copying lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:43:28,435 copying lm_eval/tasks/noreval/ask_gec/README.md -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:28,437 copying lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:28,441 copying lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa 2025-11-27T00:43:28,445 copying lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/lib/lm_eval/tasks/noreval/tatoeba 2025-11-27T00:43:28,447 copying lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:43:28,450 copying lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/lib/lm_eval/tasks/noreval/noridiom 2025-11-27T00:43:28,453 copying lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa 2025-11-27T00:43:28,456 copying lm_eval/tasks/noreval/norec/_norec_yaml -> build/lib/lm_eval/tasks/noreval/norec 2025-11-27T00:43:28,459 copying lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/lib/lm_eval/tasks/noreval/norsumm 2025-11-27T00:43:28,462 copying lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:28,464 copying lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/lib/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:28,467 copying lm_eval/tasks/medtext/README.md -> build/lib/lm_eval/tasks/medtext 2025-11-27T00:43:28,471 copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2 2025-11-27T00:43:28,473 copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading 2025-11-27T00:43:28,477 copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue 2025-11-27T00:43:28,485 copying lm_eval/tasks/esbbq/README.md -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:28,488 copying lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/lib/lm_eval/tasks/esbbq 2025-11-27T00:43:28,491 copying lm_eval/tasks/mmlu-redux/generative/README.md -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:28,493 copying lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:28,496 copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:28,499 copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma 2025-11-27T00:43:28,501 copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs 2025-11-27T00:43:28,505 copying lm_eval/tasks/acpbench/README.md -> build/lib/lm_eval/tasks/acpbench 2025-11-27T00:43:28,508 copying lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:28,511 copying lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:28,513 copying lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:28,515 copying lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:28,517 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:28,521 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:28,523 copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu 2025-11-27T00:43:28,527 copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu 2025-11-27T00:43:28,529 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:28,532 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:28,535 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:28,538 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:28,541 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:28,545 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:28,548 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:28,551 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:28,554 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:28,557 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:28,560 copying lm_eval/tasks/icelandic_winogrande/README.md -> build/lib/lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:28,564 copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:28,566 copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu 2025-11-27T00:43:28,569 copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273 2025-11-27T00:43:28,572 copying lm_eval/tasks/mts_dialog/README.md -> build/lib/lm_eval/tasks/mts_dialog 2025-11-27T00:43:28,577 copying lm_eval/tasks/code_x_glue/code-text/README.md -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:28,582 copying lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:28,585 copying lm_eval/tasks/aradice/README.md -> build/lib/lm_eval/tasks/aradice 2025-11-27T00:43:28,605 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:28,610 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:28,613 copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency 2025-11-27T00:43:28,616 copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu 2025-11-27T00:43:28,620 copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:28,623 copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:28,626 copying lm_eval/tasks/gsm8k_platinum/README.md -> build/lib/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:28,629 copying lm_eval/tasks/aime/README.md -> build/lib/lm_eval/tasks/aime 2025-11-27T00:43:28,633 copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls 2025-11-27T00:43:28,638 copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl 2025-11-27T00:43:28,643 copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:28,646 copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:28,649 copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:28,652 copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:28,655 copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:28,658 copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:28,661 copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper 2025-11-27T00:43:28,666 copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:28,671 copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:28,674 copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2025-11-27T00:43:28,677 copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:28,679 copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:28,682 copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard 2025-11-27T00:43:28,685 copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:28,689 copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:28,694 copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:28,697 copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:28,701 copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr 2025-11-27T00:43:28,704 copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:28,708 copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:28,711 copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:28,713 copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu 2025-11-27T00:43:28,717 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:28,726 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:28,729 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:28,732 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:28,734 copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default 2025-11-27T00:43:28,736 copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:28,739 copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:28,742 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:28,745 copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016 2025-11-27T00:43:28,748 copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval 2025-11-27T00:43:28,752 copying lm_eval/tasks/humaneval/README.md -> build/lib/lm_eval/tasks/humaneval 2025-11-27T00:43:28,755 copying lm_eval/tasks/global_mmlu/README.md -> build/lib/lm_eval/tasks/global_mmlu 2025-11-27T00:43:28,758 copying lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:28,762 copying lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:28,764 copying lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:28,768 copying lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:28,771 copying lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:28,775 copying lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:28,777 copying lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:28,781 copying lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:28,786 copying lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:28,789 copying lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:28,792 copying lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:28,795 copying lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:28,805 copying lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:28,810 copying lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:28,814 copying lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:28,816 copying lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:28,820 copying lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:28,823 copying lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:28,826 copying lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:28,829 copying lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:28,832 copying lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:28,836 copying lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:28,839 copying lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:28,842 copying lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:28,844 copying lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:28,848 copying lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:28,853 copying lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:28,855 copying lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:28,864 copying lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:28,868 copying lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:28,871 copying lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:28,874 copying lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:28,877 copying lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:28,880 copying lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:28,883 copying lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:28,886 copying lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:28,889 copying lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:28,892 copying lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:28,896 copying lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:28,899 copying lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:28,901 copying lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:28,904 copying lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:28,907 copying lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:28,911 copying lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:28,914 copying lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:28,916 copying lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:28,919 copying lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:28,922 copying lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:28,925 copying lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:28,928 copying lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:28,931 copying lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:28,935 copying lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:28,938 copying lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:28,941 copying lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:28,943 copying lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:28,946 copying lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:43:28,950 copying lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:43:28,952 copying lm_eval/tasks/histoires_morales/README.md -> build/lib/lm_eval/tasks/histoires_morales 2025-11-27T00:43:28,955 copying lm_eval/tasks/cabbq/README.md -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:28,958 copying lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/lib/lm_eval/tasks/cabbq 2025-11-27T00:43:28,961 copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:28,963 copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2025-11-27T00:43:28,966 copying lm_eval/tasks/evalita_llm/README.md -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,968 copying lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,970 copying lm_eval/tasks/evalita_llm/_at_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,973 copying lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,975 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,978 copying lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,980 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,982 copying lm_eval/tasks/evalita_llm/_te_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,984 copying lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,987 copying lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,990 copying lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,992 copying lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,995 copying lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,997 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:28,999 copying lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:29,001 copying lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:29,004 copying lm_eval/tasks/evalita_llm/_re_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2025-11-27T00:43:29,006 copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2 2025-11-27T00:43:29,009 copying lm_eval/tasks/meddialog/README.md -> build/lib/lm_eval/tasks/meddialog 2025-11-27T00:43:29,013 copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa 2025-11-27T00:43:29,015 copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble 2025-11-27T00:43:29,019 copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa 2025-11-27T00:43:29,021 copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:43:29,024 copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:43:29,027 copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:43:29,030 copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench 2025-11-27T00:43:29,032 copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela 2025-11-27T00:43:29,035 copying lm_eval/tasks/mmlu-pro-plus/README.md -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:29,038 copying lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:43:29,040 copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:29,042 copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:43:29,045 copying lm_eval/tasks/libra/README.md -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:29,048 copying lm_eval/tasks/libra/_template_yaml -> build/lib/lm_eval/tasks/libra 2025-11-27T00:43:29,051 copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:29,053 copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd 2025-11-27T00:43:29,056 copying lm_eval/tasks/benchmarks/README.md -> build/lib/lm_eval/tasks/benchmarks 2025-11-27T00:43:29,058 copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2025-11-27T00:43:29,061 copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:43:29,064 copying lm_eval/tasks/hrm8k/README.md -> build/lib/lm_eval/tasks/hrm8k 2025-11-27T00:43:29,067 copying lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/lib/lm_eval/tasks/hrm8k/default 2025-11-27T00:43:29,069 copying lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/lib/lm_eval/tasks/hrm8k/en 2025-11-27T00:43:29,072 copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs 2025-11-27T00:43:29,076 copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue 2025-11-27T00:43:29,079 copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:29,082 copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu 2025-11-27T00:43:29,085 copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag 2025-11-27T00:43:29,088 copying lm_eval/tasks/darija_bench/README.md -> build/lib/lm_eval/tasks/darija_bench 2025-11-27T00:43:29,091 copying lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:29,093 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:43:29,096 copying lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:29,098 copying lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:43:29,101 copying lm_eval/tasks/darija_bench/darija_translation/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,104 copying lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,106 copying lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,109 copying lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,112 copying lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,114 copying lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:43:29,117 copying lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:43:29,120 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:43:29,122 copying lm_eval/tasks/babilong/README.md -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:29,125 copying lm_eval/tasks/babilong/_babilong_common_yaml -> build/lib/lm_eval/tasks/babilong 2025-11-27T00:43:29,127 copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:29,131 copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp 2025-11-27T00:43:29,133 copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa 2025-11-27T00:43:29,136 copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt 2025-11-27T00:43:29,138 copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:29,141 copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval 2025-11-27T00:43:29,144 copying lm_eval/tasks/egyhellaswag/README.md -> build/lib/lm_eval/tasks/egyhellaswag 2025-11-27T00:43:29,147 copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu 2025-11-27T00:43:29,150 copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu 2025-11-27T00:43:29,153 copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default 2025-11-27T00:43:29,156 copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld 2025-11-27T00:43:29,158 copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math 2025-11-27T00:43:29,162 copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia 2025-11-27T00:43:29,166 copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa 2025-11-27T00:43:29,170 copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race 2025-11-27T00:43:29,174 copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual 2025-11-27T00:43:29,176 copying lm_eval/tasks/darijahellaswag/README.md -> build/lib/lm_eval/tasks/darijahellaswag 2025-11-27T00:43:29,179 copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa 2025-11-27T00:43:29,182 copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus 2025-11-27T00:43:29,185 copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa 2025-11-27T00:43:29,188 copying lm_eval/tasks/global_piqa/README.md -> build/lib/lm_eval/tasks/global_piqa 2025-11-27T00:43:29,191 copying lm_eval/tasks/global_piqa/prompted/_template -> build/lib/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:43:29,194 copying lm_eval/tasks/global_piqa/completions/_template -> build/lib/lm_eval/tasks/global_piqa/completions 2025-11-27T00:43:29,197 copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli 2025-11-27T00:43:29,200 copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:29,203 copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad 2025-11-27T00:43:29,206 copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench 2025-11-27T00:43:29,212 copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa 2025-11-27T00:43:29,214 copying lm_eval/tasks/bangla/README.md -> build/lib/lm_eval/tasks/bangla 2025-11-27T00:43:29,217 copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math 2025-11-27T00:43:29,220 copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k 2025-11-27T00:43:29,222 copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde 2025-11-27T00:43:29,226 copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k 2025-11-27T00:43:29,228 copying lm_eval/tasks/meqsum/README.md -> build/lib/lm_eval/tasks/meqsum 2025-11-27T00:43:29,232 copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:29,236 copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu 2025-11-27T00:43:29,238 copying lm_eval/tasks/chartqa/README.md -> build/lib/lm_eval/tasks/chartqa 2025-11-27T00:43:29,241 copying lm_eval/tasks/zhoblimp/README.md -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:29,244 copying lm_eval/tasks/zhoblimp/_template_yaml -> build/lib/lm_eval/tasks/zhoblimp 2025-11-27T00:43:29,247 copying lm_eval/tasks/moral_stories/README.md -> build/lib/lm_eval/tasks/moral_stories 2025-11-27T00:43:29,251 copying lm_eval/tasks/llama3/README.md -> build/lib/lm_eval/tasks/llama3 2025-11-27T00:43:29,255 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:43:29,258 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:43:29,262 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:43:29,265 copying lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:43:29,268 copying lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:43:29,270 copying lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:43:29,272 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:43:29,276 copying lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:43:29,280 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:43:29,283 copying lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:43:29,285 copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest 2025-11-27T00:43:29,288 copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex 2025-11-27T00:43:29,291 copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi 2025-11-27T00:43:29,294 copying lm_eval/tasks/mlqa/README.md -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:29,296 copying lm_eval/tasks/mlqa/mlqa_common_yaml -> build/lib/lm_eval/tasks/mlqa 2025-11-27T00:43:29,300 copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench 2025-11-27T00:43:29,304 copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:43:29,306 copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:29,309 copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:29,311 copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling 2025-11-27T00:43:29,314 copying lm_eval/tasks/mediqa_qa2019/README.md -> build/lib/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:43:29,318 copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:29,320 copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu 2025-11-27T00:43:29,323 copying lm_eval/tasks/truthfulqa-multi/README.md -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:29,326 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:29,328 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:43:29,331 copying lm_eval/tasks/longbench2/README.md -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:29,333 copying lm_eval/tasks/longbench2/_longbench_common_yaml -> build/lib/lm_eval/tasks/longbench2 2025-11-27T00:43:29,335 copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada 2025-11-27T00:43:29,338 copying lm_eval/tasks/bbq/README.md -> build/lib/lm_eval/tasks/bbq 2025-11-27T00:43:29,341 copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench 2025-11-27T00:43:29,345 copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:29,348 copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:43:29,351 copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:29,353 copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:43:29,356 copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:29,358 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:29,360 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:43:29,363 copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:43:29,366 copying lm_eval/tasks/blimp_nl/README.md -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:29,369 copying lm_eval/tasks/blimp_nl/_template_yaml -> build/lib/lm_eval/tasks/blimp_nl 2025-11-27T00:43:37,689 installing to build/bdist.linux-armv7l/wheel 2025-11-27T00:43:37,690 running install 2025-11-27T00:43:37,713 running install_lib 2025-11-27T00:43:37,719 creating build/bdist.linux-armv7l/wheel 2025-11-27T00:43:37,721 creating build/bdist.linux-armv7l/wheel/lm_eval 2025-11-27T00:43:37,723 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2025-11-27T00:43:37,724 copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,727 copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,729 copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,732 copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,734 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,736 copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,738 copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,740 copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,743 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,745 copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,748 copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,751 copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,753 copying build/lib/lm_eval/models/sglang_generate_API.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,755 copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,758 copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,761 copying build/lib/lm_eval/models/sglang_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,763 copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,766 copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,768 copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,771 copying build/lib/lm_eval/models/hf_steered.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,773 copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,775 copying build/lib/lm_eval/models/hf_audiolm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2025-11-27T00:43:37,778 creating build/bdist.linux-armv7l/wheel/lm_eval/api 2025-11-27T00:43:37,779 copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,781 copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,784 copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,785 copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,787 copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,790 copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,792 copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,794 copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,798 copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2025-11-27T00:43:37,800 creating build/bdist.linux-armv7l/wheel/lm_eval/prompts 2025-11-27T00:43:37,801 copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts 2025-11-27T00:43:37,804 creating build/bdist.linux-armv7l/wheel/lm_eval/caching 2025-11-27T00:43:37,805 copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2025-11-27T00:43:37,806 copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2025-11-27T00:43:37,809 creating build/bdist.linux-armv7l/wheel/lm_eval/loggers 2025-11-27T00:43:37,810 copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2025-11-27T00:43:37,813 copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2025-11-27T00:43:37,814 copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2025-11-27T00:43:37,817 copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2025-11-27T00:43:37,819 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2025-11-27T00:43:37,823 creating build/bdist.linux-armv7l/wheel/lm_eval/filters 2025-11-27T00:43:37,824 copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,826 copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,828 copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,830 copying build/lib/lm_eval/filters/custom.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,832 copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,834 copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2025-11-27T00:43:37,837 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2025-11-27T00:43:37,841 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2025-11-27T00:43:37,855 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2025-11-27T00:43:37,859 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande 2025-11-27T00:43:37,862 copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2025-11-27T00:43:37,864 copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2025-11-27T00:43:37,866 copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2025-11-27T00:43:37,868 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp 2025-11-27T00:43:37,869 copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,871 copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,873 copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,875 copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,877 copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,878 copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2025-11-27T00:43:37,881 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze 2025-11-27T00:43:37,882 copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2025-11-27T00:43:37,884 copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2025-11-27T00:43:37,885 copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2025-11-27T00:43:37,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/multiblimp 2025-11-27T00:43:37,891 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,893 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,894 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,896 copying build/lib/lm_eval/tasks/multiblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,898 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,900 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,902 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,904 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,906 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,907 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,909 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,911 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,913 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,914 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,916 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,918 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,920 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,921 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,923 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,925 copying build/lib/lm_eval/tasks/multiblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,926 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,928 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,930 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,932 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,933 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,935 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,937 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,939 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,940 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,942 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,944 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,946 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,948 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,949 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,951 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,953 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,955 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,957 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,959 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,961 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,962 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,964 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,965 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,967 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,969 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,971 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,972 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,974 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,976 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,977 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,979 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,981 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,983 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,985 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,987 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,989 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,990 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,992 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,994 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,996 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,997 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:37,999 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,001 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,003 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,005 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,007 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,009 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,011 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,012 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,014 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,016 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,017 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,019 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,021 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,023 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,025 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,027 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,028 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,030 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,032 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,033 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,035 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,037 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,039 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,041 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,043 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,044 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,046 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,048 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,050 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,051 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,053 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,055 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,057 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,059 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,061 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,062 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,064 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,066 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,067 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,069 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,071 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,073 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2025-11-27T00:43:38,075 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa 2025-11-27T00:43:38,076 copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2025-11-27T00:43:38,078 copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2025-11-27T00:43:38,080 copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2025-11-27T00:43:38,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench 2025-11-27T00:43:38,083 copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,085 copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,087 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,089 copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,091 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,093 copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,095 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,097 copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,099 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,101 copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,103 copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,105 copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,107 copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,109 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,110 copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,112 copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,114 copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,116 copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,117 copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,120 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,121 copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,123 copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2025-11-27T00:43:38,126 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,127 copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,129 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,131 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,133 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,135 copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,137 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,139 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,141 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,143 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,144 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,146 copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,148 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,150 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,152 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,154 copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,156 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,158 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,159 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2025-11-27T00:43:38,161 copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2025-11-27T00:43:38,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa 2025-11-27T00:43:38,167 copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2025-11-27T00:43:38,169 copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2025-11-27T00:43:38,171 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open 2025-11-27T00:43:38,172 copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2025-11-27T00:43:38,174 copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2025-11-27T00:43:38,177 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture 2025-11-27T00:43:38,178 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,180 copying build/lib/lm_eval/tasks/arab_culture/utils_mcq.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,181 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,183 copying build/lib/lm_eval/tasks/arab_culture/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,185 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,186 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,188 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,190 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,192 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,194 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,195 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,197 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,199 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,200 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,202 copying build/lib/lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,204 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,206 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,207 copying build/lib/lm_eval/tasks/arab_culture/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,209 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,211 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,213 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,214 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,216 copying build/lib/lm_eval/tasks/arab_culture/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2025-11-27T00:43:38,219 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli 2025-11-27T00:43:38,220 copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2025-11-27T00:43:38,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt 2025-11-27T00:43:38,223 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,225 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,226 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,228 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,230 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,231 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,233 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,235 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,237 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,239 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,240 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,242 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,244 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,246 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,247 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,249 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,251 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,253 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,254 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,256 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,258 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2025-11-27T00:43:38,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,262 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,264 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,266 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,267 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,269 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,271 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,273 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,275 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,277 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,278 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,280 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,282 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,284 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,286 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,287 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,289 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,291 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,293 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,295 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2025-11-27T00:43:38,297 copying build/lib/lm_eval/tasks/afrixnli/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2025-11-27T00:43:38,299 copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2025-11-27T00:43:38,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct 2025-11-27T00:43:38,303 copying build/lib/lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct 2025-11-27T00:43:38,305 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,306 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,308 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,310 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,312 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,314 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,315 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,317 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,319 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,321 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,323 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,325 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,327 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,328 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,330 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,332 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,334 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,336 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,338 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,339 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,341 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2025-11-27T00:43:38,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,344 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,346 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,348 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,350 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,351 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,353 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,355 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,357 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,359 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,361 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,363 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,365 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,367 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,368 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,370 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,372 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,374 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,376 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,377 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,379 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2025-11-27T00:43:38,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,383 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,385 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,387 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,388 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,390 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,392 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,394 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,395 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,397 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,399 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,401 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,403 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,404 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,406 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,408 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,410 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,412 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,413 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,415 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,417 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2025-11-27T00:43:38,420 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,421 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,423 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,425 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,426 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,428 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,430 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,432 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,434 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,435 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,437 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,439 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,441 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,442 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,444 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,446 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,448 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,450 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,452 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,454 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,455 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2025-11-27T00:43:38,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,459 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,461 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,463 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,465 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,467 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,469 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,470 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,472 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,474 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,476 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,477 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,479 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,481 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,483 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,485 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,487 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,489 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,491 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,493 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,494 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2025-11-27T00:43:38,497 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt 2025-11-27T00:43:38,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,500 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,502 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,503 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,505 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,507 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,509 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,511 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,512 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,514 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,516 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,517 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,519 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,521 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,523 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,524 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,526 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,528 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,530 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,532 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,533 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2025-11-27T00:43:38,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,537 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,539 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,541 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,543 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,544 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,546 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,548 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,550 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,552 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,553 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,555 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,557 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,559 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,561 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,562 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,564 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,566 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,568 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,570 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,571 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2025-11-27T00:43:38,574 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,575 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,577 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,579 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,581 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,583 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,585 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,587 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,588 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,590 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,592 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,594 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,595 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,597 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,599 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,601 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,603 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,605 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,607 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,608 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2025-11-27T00:43:38,611 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate 2025-11-27T00:43:38,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,614 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,616 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,617 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,619 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,621 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,623 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,625 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,627 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,628 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,630 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,632 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,634 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,635 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,637 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,639 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,641 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,643 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,644 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,646 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2025-11-27T00:43:38,649 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,650 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,653 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,654 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,656 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,658 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,660 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,662 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,664 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,665 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,667 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,669 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,670 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,672 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,674 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,676 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,677 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,679 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,681 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,683 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2025-11-27T00:43:38,685 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,686 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,689 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,690 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,692 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,694 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,696 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,698 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,699 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,701 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,703 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,705 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,707 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,709 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,711 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,712 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,714 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,716 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,718 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,720 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2025-11-27T00:43:38,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,723 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,725 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,727 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,729 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,730 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,732 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,734 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,736 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,737 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,739 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,741 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,743 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,745 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,746 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,748 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,750 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,751 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,753 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,755 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2025-11-27T00:43:38,757 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,758 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,760 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,762 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,764 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,766 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,768 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,770 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,772 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,774 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,775 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,777 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,779 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,781 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,782 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,784 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,786 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,788 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,790 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,791 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2025-11-27T00:43:38,793 copying build/lib/lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate 2025-11-27T00:43:38,796 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench 2025-11-27T00:43:38,798 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti 2025-11-27T00:43:38,799 copying build/lib/lm_eval/tasks/afrobench/nollysenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2025-11-27T00:43:38,801 copying build/lib/lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2025-11-27T00:43:38,803 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,804 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,806 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,808 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,810 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,812 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,814 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,816 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2025-11-27T00:43:38,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,819 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,821 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,823 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,825 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,827 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,829 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,831 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2025-11-27T00:43:38,833 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,834 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,836 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,838 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,840 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,841 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,843 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,845 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2025-11-27T00:43:38,847 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,848 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,851 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,852 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,854 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,856 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,858 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,860 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2025-11-27T00:43:38,862 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,864 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,866 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,868 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,870 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,871 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,873 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,875 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2025-11-27T00:43:38,877 copying build/lib/lm_eval/tasks/afrobench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2025-11-27T00:43:38,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:38,880 copying build/lib/lm_eval/tasks/afrobench/naijarc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:38,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:38,884 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:38,886 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:38,888 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:38,889 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2025-11-27T00:43:38,892 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:38,893 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:38,895 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:38,896 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:38,898 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2025-11-27T00:43:38,900 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:38,902 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:38,904 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:38,905 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:38,907 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2025-11-27T00:43:38,910 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:38,911 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:38,913 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:38,915 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:38,917 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2025-11-27T00:43:38,918 copying build/lib/lm_eval/tasks/afrobench/naijarc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:38,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:38,922 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:38,924 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:38,925 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:38,927 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2025-11-27T00:43:38,929 copying build/lib/lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2025-11-27T00:43:38,931 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:38,932 copying build/lib/lm_eval/tasks/afrobench/ntrex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:38,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3 2025-11-27T00:43:38,937 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,938 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,940 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,942 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,943 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,945 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,947 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,949 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,951 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,952 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,954 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,956 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,958 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,960 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,962 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,963 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,965 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,967 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,969 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,971 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,972 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,974 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,976 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,978 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,979 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,981 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,983 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,985 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,987 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,989 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,990 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,992 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,994 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,995 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2025-11-27T00:43:38,998 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:38,999 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,001 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,003 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,004 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,006 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,008 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,010 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,012 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,013 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,015 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,017 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,019 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,020 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,022 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,024 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,026 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,028 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,029 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,031 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,033 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,034 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,036 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,038 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,040 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,042 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,043 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,045 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,047 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,049 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,051 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,053 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,055 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,056 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2025-11-27T00:43:39,059 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1 2025-11-27T00:43:39,061 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,062 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,064 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,066 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,068 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,070 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,072 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,074 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,075 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,077 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,079 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,080 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,082 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,084 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,086 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,087 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,089 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,091 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,093 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,095 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,096 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,098 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,100 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,101 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,103 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,104 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,106 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,108 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,110 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,112 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,113 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,115 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,117 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,119 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2025-11-27T00:43:39,121 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,122 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,124 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,126 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,128 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,130 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,131 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,133 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,135 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,136 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,138 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,140 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,142 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,144 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,145 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,147 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,149 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,151 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,152 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,154 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,156 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,158 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,159 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,161 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,163 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,165 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,166 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,168 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,170 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,172 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,173 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,175 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,177 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,178 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2025-11-27T00:43:39,180 copying build/lib/lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:39,182 copying build/lib/lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2025-11-27T00:43:39,185 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2 2025-11-27T00:43:39,187 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,188 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,190 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,192 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,194 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,196 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,197 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,199 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,201 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,202 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,204 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,206 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,207 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,209 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,212 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,214 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,215 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,217 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,219 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,221 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,223 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,224 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,226 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,228 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,230 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,232 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,234 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,235 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,237 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,239 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,241 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,243 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,245 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,246 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2025-11-27T00:43:39,249 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,250 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,252 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,254 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,255 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,257 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,259 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,261 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,262 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,264 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,266 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,268 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,269 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,271 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,273 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,274 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,276 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,278 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,280 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,281 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,283 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,285 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,286 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,288 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,290 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,292 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,293 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,295 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,297 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,299 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,301 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,302 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,304 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,306 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2025-11-27T00:43:39,308 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:39,309 copying build/lib/lm_eval/tasks/afrobench/mafand/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:39,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3 2025-11-27T00:43:39,313 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,315 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,317 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,318 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,320 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,322 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,323 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,325 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,327 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,329 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,330 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,332 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,334 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,335 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,337 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,339 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,341 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,343 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,344 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,346 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,347 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,349 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,351 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,353 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2025-11-27T00:43:39,355 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,356 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,358 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,360 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,361 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,363 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,365 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,367 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,368 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,370 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,372 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,374 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,375 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,377 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,379 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,381 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,382 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,384 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,386 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,387 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,389 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,391 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,392 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,394 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2025-11-27T00:43:39,396 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1 2025-11-27T00:43:39,398 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,399 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,401 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,403 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,405 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,407 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,408 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,410 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,411 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,413 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,415 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,416 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,418 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,420 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,422 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,423 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,425 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,427 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,429 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,430 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,432 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,434 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,435 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,437 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2025-11-27T00:43:39,440 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,441 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,443 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,444 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,446 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,448 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,450 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,451 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,453 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,455 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,456 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,458 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,460 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,462 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,464 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,465 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,467 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,469 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,471 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,472 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,474 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,476 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,478 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,479 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2025-11-27T00:43:39,481 copying build/lib/lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:39,484 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2 2025-11-27T00:43:39,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,486 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,488 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,490 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,492 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,493 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,495 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,497 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,499 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,501 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,503 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,504 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,506 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,508 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,513 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,516 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,519 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,522 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,526 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,531 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,539 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,544 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,549 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,551 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2025-11-27T00:43:39,553 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,554 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,556 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,558 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,559 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,561 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,563 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,565 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,567 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,569 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,571 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,573 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,574 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,577 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,578 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,580 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,582 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,584 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,586 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,587 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,589 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,591 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,592 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,594 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2025-11-27T00:43:39,596 copying build/lib/lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2025-11-27T00:43:39,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:39,600 copying build/lib/lm_eval/tasks/afrobench/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:39,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,604 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,606 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,607 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,609 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,611 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,613 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,614 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,616 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,618 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,619 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,621 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,623 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,624 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,626 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,628 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,630 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,631 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,633 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,635 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,636 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,638 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,640 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,642 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,643 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,645 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,647 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,649 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,650 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,652 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,654 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,655 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,657 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2025-11-27T00:43:39,659 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,660 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,662 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,664 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,665 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,667 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,670 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,673 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,676 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,678 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,679 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,681 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,683 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,685 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,686 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,688 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,690 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,692 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,693 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,695 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,697 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,698 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,700 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,701 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,703 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,705 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,707 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,708 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,710 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,712 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,713 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,715 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,717 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2025-11-27T00:43:39,720 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,721 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,723 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,724 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,726 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,728 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,730 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,731 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,733 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,735 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,736 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,738 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,740 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,741 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,743 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,745 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,746 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,748 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,750 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,752 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,753 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,755 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,757 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,759 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,760 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,762 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,764 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,766 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,767 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,770 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,771 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,773 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,775 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2025-11-27T00:43:39,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,778 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,780 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,782 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,784 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,785 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,787 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,789 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,790 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,792 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,794 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,796 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,797 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,799 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,801 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,802 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,804 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,806 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,808 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,810 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,811 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,813 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,815 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,816 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,818 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,820 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,821 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,823 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,825 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,826 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,828 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,830 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,831 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2025-11-27T00:43:39,835 copying build/lib/lm_eval/tasks/afrobench/belebele/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:39,838 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,839 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,842 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,844 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,846 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,847 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,849 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,851 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,853 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,854 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,856 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,858 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,860 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,861 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,863 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,865 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,866 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,868 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,870 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,872 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,873 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,875 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,877 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,878 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,880 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,882 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,884 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,885 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,887 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,889 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,891 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,893 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,894 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2025-11-27T00:43:39,896 copying build/lib/lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2025-11-27T00:43:39,898 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:39,899 copying build/lib/lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:39,901 copying build/lib/lm_eval/tasks/afrobench/injongointent/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:39,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,905 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,906 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,908 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,910 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,911 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,913 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,915 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,917 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,918 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,920 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,922 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,924 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,925 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,927 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,929 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,931 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,932 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,934 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,936 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2025-11-27T00:43:39,938 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,939 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,941 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,943 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,945 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,946 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,948 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,950 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,952 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,953 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,955 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,957 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,958 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,960 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,962 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,964 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,966 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,967 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,969 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,971 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2025-11-27T00:43:39,973 copying build/lib/lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2025-11-27T00:43:39,976 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,976 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,978 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,980 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,982 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,983 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,985 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,987 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,988 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,990 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,992 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,994 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,995 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,997 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:39,999 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,000 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,002 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,004 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,006 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,008 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2025-11-27T00:43:40,010 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,011 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,013 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,015 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,016 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,018 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,020 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,021 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,023 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,025 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,027 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,028 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,030 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,032 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,033 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,035 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,037 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,039 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,040 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,042 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2025-11-27T00:43:40,045 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,046 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,047 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,049 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,051 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,053 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,054 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,056 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,058 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,060 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,061 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,063 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,065 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,067 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,069 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,070 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,072 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,074 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,076 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,078 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2025-11-27T00:43:40,080 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:40,081 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:40,084 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:40,085 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:40,087 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:40,089 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:40,090 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2025-11-27T00:43:40,092 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:40,093 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:40,095 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:40,097 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:40,099 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2025-11-27T00:43:40,100 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:40,103 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:40,104 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:40,105 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:40,107 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:40,109 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2025-11-27T00:43:40,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:40,112 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:40,114 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:40,116 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:40,118 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2025-11-27T00:43:40,120 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2025-11-27T00:43:40,122 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:40,123 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:40,125 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:40,127 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:40,129 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2025-11-27T00:43:40,131 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:40,132 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:40,134 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2025-11-27T00:43:40,136 copying build/lib/lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2025-11-27T00:43:40,138 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr 2025-11-27T00:43:40,140 copying build/lib/lm_eval/tasks/afrobench/adr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2025-11-27T00:43:40,142 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,143 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,145 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,146 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,148 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,150 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,152 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2025-11-27T00:43:40,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,155 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,157 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,159 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,161 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,162 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,164 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2025-11-27T00:43:40,166 copying build/lib/lm_eval/tasks/afrobench/adr/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2025-11-27T00:43:40,168 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,170 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,172 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,173 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,175 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,177 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,178 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2025-11-27T00:43:40,181 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,182 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,184 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,185 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,187 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,189 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,191 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2025-11-27T00:43:40,193 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,194 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,196 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,198 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,200 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,201 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,203 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2025-11-27T00:43:40,205 copying build/lib/lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2025-11-27T00:43:40,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:40,208 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:40,211 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,212 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,214 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,215 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,217 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,219 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,220 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,222 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,224 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,225 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2025-11-27T00:43:40,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,229 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,231 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,232 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,234 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,236 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,238 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,240 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,242 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,243 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2025-11-27T00:43:40,246 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,247 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,248 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,250 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,252 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,254 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,256 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,257 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,259 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,261 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2025-11-27T00:43:40,263 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,264 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,266 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,268 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,270 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,271 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,273 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,275 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,276 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,279 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2025-11-27T00:43:40,280 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:40,283 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,284 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,286 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,287 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,289 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,291 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,293 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,295 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,296 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,298 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2025-11-27T00:43:40,300 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2025-11-27T00:43:40,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt 2025-11-27T00:43:40,303 copying build/lib/lm_eval/tasks/afrobench/salt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2025-11-27T00:43:40,305 copying build/lib/lm_eval/tasks/afrobench/salt/salt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2025-11-27T00:43:40,307 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,308 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,310 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,312 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,313 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,315 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,317 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,319 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,320 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,322 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,324 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,326 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,327 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,329 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,331 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,333 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2025-11-27T00:43:40,335 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,336 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,338 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,340 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,342 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,343 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,345 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,347 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,348 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,350 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,352 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,354 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,356 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,357 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,359 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,361 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2025-11-27T00:43:40,363 copying build/lib/lm_eval/tasks/afrobench/salt/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2025-11-27T00:43:40,365 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,366 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,368 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,370 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,372 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,373 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,375 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,377 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,379 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,380 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,382 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,384 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,386 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,387 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,389 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,391 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2025-11-27T00:43:40,393 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:40,394 copying build/lib/lm_eval/tasks/afrobench/afrisenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:40,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,398 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,400 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,402 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,403 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,405 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,407 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,409 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,410 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,412 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,414 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,416 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,418 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,419 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,421 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,422 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,424 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,426 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2025-11-27T00:43:40,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,429 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,431 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,432 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,434 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,436 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,437 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,439 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,441 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,443 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,444 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,446 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,448 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,449 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,451 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,453 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,455 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,456 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,458 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2025-11-27T00:43:40,460 copying build/lib/lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:40,462 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,463 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,465 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,466 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,468 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,470 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,471 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,473 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,475 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,476 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,478 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,480 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,482 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,483 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,485 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,487 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,489 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,491 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2025-11-27T00:43:40,493 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,494 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,496 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,498 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,499 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,501 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,502 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,504 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,506 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,508 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,509 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,511 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,513 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,515 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,516 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,518 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,520 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,522 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,523 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2025-11-27T00:43:40,525 copying build/lib/lm_eval/tasks/afrobench/afrisenti/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:40,527 copying build/lib/lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2025-11-27T00:43:40,530 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,531 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,533 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,534 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,536 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,538 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,540 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,541 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,543 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,545 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,546 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,548 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,550 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,552 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,553 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,555 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,557 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,558 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2025-11-27T00:43:40,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:40,562 copying build/lib/lm_eval/tasks/afrobench/masakhaner/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:40,565 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,566 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,567 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,569 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,571 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,573 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,574 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,576 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,578 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,580 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,582 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,583 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,585 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,586 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,588 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,590 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,592 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,593 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,595 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,597 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,599 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,600 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,602 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2025-11-27T00:43:40,605 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,606 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,608 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,609 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,611 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,613 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,615 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,617 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,619 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,621 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,623 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,624 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,626 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,628 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,630 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,631 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,633 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,635 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,637 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,639 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,641 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,642 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,644 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2025-11-27T00:43:40,646 copying build/lib/lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:40,649 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,650 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,652 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,654 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,655 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,657 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,659 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,661 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,662 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,664 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,666 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,667 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,669 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,671 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,672 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,674 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,676 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,678 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,680 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,681 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,683 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,685 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,687 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2025-11-27T00:43:40,689 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,690 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,692 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,694 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,696 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,697 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,699 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,701 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,703 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,704 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,706 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,708 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,710 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,711 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,713 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,715 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,717 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,719 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,721 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,723 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,724 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,726 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,728 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2025-11-27T00:43:40,731 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,732 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,734 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,736 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,738 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,739 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,741 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,743 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,744 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,746 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,748 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,750 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,751 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,753 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,755 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,756 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,759 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,760 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,762 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,764 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,766 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,767 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,769 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2025-11-27T00:43:40,771 copying build/lib/lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2025-11-27T00:43:40,773 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:40,774 copying build/lib/lm_eval/tasks/afrobench/masakhapos/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:40,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,778 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,780 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,782 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,783 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,785 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,787 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,788 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,790 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,792 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,793 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,795 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,797 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,799 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,801 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,802 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,804 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,806 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,807 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,809 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,811 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,813 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,815 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2025-11-27T00:43:40,817 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,818 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,820 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,822 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,823 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,825 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,827 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,828 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,830 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,832 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,834 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,836 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,838 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,839 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,841 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,843 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,845 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,846 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,848 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,850 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,852 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,854 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,856 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2025-11-27T00:43:40,858 copying build/lib/lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:40,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,862 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,863 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,865 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,867 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,868 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,870 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,872 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,874 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,876 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,877 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,879 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,881 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,883 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,884 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,886 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,888 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,890 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,891 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,893 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,895 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,897 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,899 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2025-11-27T00:43:40,901 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,902 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,904 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,905 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,907 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,909 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,910 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,912 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,914 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,916 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,917 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,919 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,921 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,923 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,925 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,927 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,928 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,930 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,932 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,934 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,936 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,938 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,939 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2025-11-27T00:43:40,941 copying build/lib/lm_eval/tasks/afrobench/masakhapos/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:40,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,944 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,946 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,948 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,950 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,951 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,953 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,955 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,957 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,958 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,960 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,962 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,964 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,966 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,967 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,969 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,971 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,973 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,975 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,977 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,979 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,981 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,982 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2025-11-27T00:43:40,984 copying build/lib/lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2025-11-27T00:43:40,986 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores 2025-11-27T00:43:40,987 copying build/lib/lm_eval/tasks/afrobench/flores/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2025-11-27T00:43:40,989 copying build/lib/lm_eval/tasks/afrobench/flores/flores.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2025-11-27T00:43:40,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3 2025-11-27T00:43:40,994 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:40,995 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:40,997 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:40,999 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,001 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,003 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,004 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,006 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,008 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,010 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,012 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,014 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,015 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,017 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,019 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,021 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,022 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,024 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,026 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,028 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,029 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,031 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,033 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,035 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,036 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,038 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,040 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,042 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,043 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,045 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,047 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,049 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,051 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,053 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,054 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,056 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,058 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,059 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,061 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,063 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,065 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,067 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,069 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,071 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,072 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,074 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,076 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,078 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,079 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,081 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,083 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,085 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,086 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,088 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,090 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,092 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,093 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,095 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,097 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,099 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,101 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,103 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,104 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,106 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2025-11-27T00:43:41,110 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,111 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,113 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,114 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,116 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,118 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,120 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,122 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,123 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,125 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,127 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,129 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,130 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,132 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,134 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,136 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,137 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,139 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,141 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,143 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,145 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,146 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,148 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,150 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,152 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,154 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,155 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,157 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,159 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,161 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,162 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,164 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,166 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,168 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,170 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,171 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,173 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,175 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,177 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,179 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,180 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,182 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,184 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,185 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,187 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,189 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,191 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,193 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,194 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,196 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,198 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,199 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,201 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,203 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,205 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,206 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,208 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,210 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,212 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,213 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,215 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,217 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,219 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,220 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2025-11-27T00:43:41,222 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3 2025-11-27T00:43:41,224 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1 2025-11-27T00:43:41,226 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,227 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,229 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,231 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,233 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,234 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,236 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,238 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,240 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,242 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,244 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,245 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,247 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,249 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,251 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,253 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,254 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,256 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,258 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,259 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,261 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,263 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,265 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,267 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,268 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,270 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,272 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,273 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,275 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,277 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,279 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,281 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,282 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,284 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,286 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,288 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,290 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,291 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,293 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,295 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,297 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,299 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,301 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,302 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,304 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,306 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,308 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,309 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,311 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,313 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,315 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,316 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,318 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,320 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,321 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,323 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,325 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,326 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,328 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,330 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,331 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,333 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,335 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,336 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2025-11-27T00:43:41,340 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,341 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,342 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,344 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,346 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,348 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,350 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,352 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,353 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,355 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,357 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,359 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,361 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,363 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,364 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,366 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,368 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,370 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,372 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,373 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,375 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,377 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,379 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,381 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,383 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,385 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,386 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,388 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,390 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,392 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,393 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,395 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,397 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,399 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,401 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,403 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,404 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,406 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,408 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,410 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,412 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,414 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,416 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,418 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,420 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,422 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,423 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,425 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,427 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,429 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,431 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,432 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,434 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,436 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,438 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,439 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,441 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,443 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,445 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,447 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,449 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,451 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,453 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,454 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2025-11-27T00:43:41,456 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1 2025-11-27T00:43:41,458 copying build/lib/lm_eval/tasks/afrobench/flores/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2025-11-27T00:43:41,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2 2025-11-27T00:43:41,463 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,464 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,466 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,467 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,469 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,471 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,473 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,475 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,478 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,480 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,482 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,484 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,487 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,489 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,491 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,494 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,496 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,498 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,500 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,503 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,505 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,507 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,509 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,511 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,514 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,516 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,518 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,521 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,523 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,526 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,528 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,531 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,533 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,536 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,538 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,540 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,543 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,545 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,547 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,550 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,552 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,554 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,557 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,559 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,562 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,564 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,566 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,569 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,571 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,573 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,575 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,577 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,579 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,581 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,583 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,584 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,586 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,588 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,590 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,592 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,594 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,595 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,597 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,599 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2025-11-27T00:43:41,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,603 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,605 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,607 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,609 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,611 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,613 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,615 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,616 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,618 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,620 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,622 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,624 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,626 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,628 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,629 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,631 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,633 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,635 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,637 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,639 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,641 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,642 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,644 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,646 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,648 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,650 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,652 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,654 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,656 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,657 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,660 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,662 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,663 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,665 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,667 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,669 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,671 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,673 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,675 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,677 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,679 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,681 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,683 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,685 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,687 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,689 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,691 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,693 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,695 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,697 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,699 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,701 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,702 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,704 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,706 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,708 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,710 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,712 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,714 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,716 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,718 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,720 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,722 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2025-11-27T00:43:41,724 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2 2025-11-27T00:43:41,726 copying build/lib/lm_eval/tasks/afrobench/afrobench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2025-11-27T00:43:41,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:41,730 copying build/lib/lm_eval/tasks/afrobench/afriqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:41,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,734 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,736 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,738 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,740 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,742 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,743 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,745 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,747 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,749 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,751 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,753 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2025-11-27T00:43:41,755 copying build/lib/lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:41,758 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,759 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,761 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,763 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,765 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,767 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,769 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,771 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,772 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,774 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,776 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,778 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2025-11-27T00:43:41,781 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,782 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,784 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,786 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,788 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,790 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,792 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,794 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,795 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,797 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,799 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,801 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2025-11-27T00:43:41,804 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,805 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,807 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,809 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,811 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,813 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,815 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,817 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,819 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,820 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,822 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,824 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2025-11-27T00:43:41,826 copying build/lib/lm_eval/tasks/afrobench/afriqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2025-11-27T00:43:41,829 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,830 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,832 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,833 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,835 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,837 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,839 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,841 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,843 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,845 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,847 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,849 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2025-11-27T00:43:41,851 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:41,852 copying build/lib/lm_eval/tasks/afrobench/xlsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:41,855 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,857 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,859 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,861 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,863 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,865 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,866 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,869 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,871 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,872 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,874 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,876 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,878 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,880 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,882 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2025-11-27T00:43:41,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,886 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,888 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,890 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,892 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,894 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,896 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,898 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,900 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,902 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,904 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,906 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,908 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,910 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,912 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2025-11-27T00:43:41,914 copying build/lib/lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:41,916 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,917 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,919 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,921 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,923 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,925 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,927 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,928 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,930 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,932 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,934 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,936 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,940 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,942 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,944 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2025-11-27T00:43:41,946 copying build/lib/lm_eval/tasks/afrobench/xlsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2025-11-27T00:43:41,948 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:41,949 copying build/lib/lm_eval/tasks/afrobench/masakhanews/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:41,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,954 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,956 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,958 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,960 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,962 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,964 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,965 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,967 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,969 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,971 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,973 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,975 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,977 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,979 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,981 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,983 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,985 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,987 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2025-11-27T00:43:41,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:41,990 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:41,992 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:41,994 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:41,996 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:41,998 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,000 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,002 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,004 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,006 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,008 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,010 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,012 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,014 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,016 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,017 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,019 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,021 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,023 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2025-11-27T00:43:42,026 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,027 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,029 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,031 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,032 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,034 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,036 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,038 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,040 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,042 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,044 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,045 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,047 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,049 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,051 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,053 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,055 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,057 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,058 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2025-11-27T00:43:42,061 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,062 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,064 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,066 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,067 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,069 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,071 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,073 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,074 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,076 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,078 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,080 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,081 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,083 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,085 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,086 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,088 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,089 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,091 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2025-11-27T00:43:42,093 copying build/lib/lm_eval/tasks/afrobench/masakhanews/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:42,096 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,097 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,098 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,100 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,102 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,104 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,105 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,107 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,109 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,111 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,112 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,114 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,116 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,117 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,119 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,121 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,122 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,124 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,125 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2025-11-27T00:43:42,127 copying build/lib/lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2025-11-27T00:43:42,129 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib 2025-11-27T00:43:42,130 copying build/lib/lm_eval/tasks/afrobench/sib/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2025-11-27T00:43:42,134 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,135 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,137 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,138 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,140 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,142 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,143 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,145 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,147 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,149 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,151 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,152 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,154 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,156 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,157 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,159 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,161 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,163 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,164 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,166 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,167 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,169 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,171 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,172 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,174 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,176 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,177 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,179 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,180 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,182 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,184 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,186 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,187 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,189 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,191 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,193 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,195 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,196 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,199 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,201 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,202 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,204 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,206 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,208 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,210 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,212 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,214 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,215 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,217 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,219 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,221 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,222 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,224 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,226 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,228 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,230 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,232 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,233 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,235 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2025-11-27T00:43:42,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,240 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,242 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,244 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,245 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,247 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,249 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,251 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,253 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,254 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,256 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,258 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,260 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,261 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,263 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,265 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,267 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,268 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,270 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,272 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,274 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,276 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,278 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,281 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,283 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,285 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,287 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,290 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,292 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,294 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,297 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,299 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,301 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,303 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,306 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,308 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,310 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,313 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,315 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,317 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,320 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,322 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,324 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,326 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,329 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,331 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,333 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,335 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,338 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,340 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,343 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,345 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,347 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,350 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,352 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,355 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,357 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,359 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,362 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2025-11-27T00:43:42,366 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,368 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,370 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,373 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,375 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,377 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,379 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,381 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,383 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,385 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,387 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,389 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,391 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,392 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,394 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,396 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,398 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,400 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,402 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,404 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,405 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,407 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,409 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,411 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,413 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,415 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,417 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,419 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,420 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,422 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,424 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,425 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,427 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,429 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,431 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,433 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,435 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,436 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,438 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,440 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,442 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,444 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,446 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,448 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,450 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,452 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,454 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,456 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,458 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,460 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,461 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,463 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,465 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,467 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,469 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,470 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,472 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,474 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,476 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2025-11-27T00:43:42,478 copying build/lib/lm_eval/tasks/afrobench/sib/sib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2025-11-27T00:43:42,481 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,482 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,484 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,486 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,488 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,490 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,492 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,494 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,495 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,497 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,499 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,501 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,503 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,505 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,506 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,508 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,510 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,512 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,514 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,515 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,517 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,519 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,521 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,523 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,524 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,526 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,528 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,530 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,532 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,534 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,536 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,538 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,540 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,541 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,543 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,545 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,547 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,549 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,551 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,552 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,554 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,556 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,558 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,559 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,561 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,563 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,565 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,567 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,569 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,570 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,572 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,574 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,576 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,578 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,580 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,582 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,584 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,586 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,587 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2025-11-27T00:43:42,589 copying build/lib/lm_eval/tasks/afrobench/sib/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2025-11-27T00:43:42,593 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,594 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,597 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,598 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,600 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,602 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,604 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,606 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,608 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,610 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,611 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,613 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,615 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,617 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,619 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,621 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,623 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,625 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,627 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,629 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,631 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,633 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,634 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,636 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,638 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,640 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,642 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,644 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,646 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,647 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,649 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,651 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,653 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,655 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,657 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,658 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,660 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,662 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,664 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,666 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,668 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,669 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,671 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,673 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,675 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,677 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,679 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,680 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,683 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,684 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,686 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,688 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,690 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,692 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,694 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,695 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,697 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,699 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,701 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2025-11-27T00:43:42,704 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x 2025-11-27T00:43:42,705 copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,707 copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,709 copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,711 copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,713 copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,715 copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,717 copying build/lib/lm_eval/tasks/paws-x/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,718 copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,720 copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,722 copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,724 copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,726 copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2025-11-27T00:43:42,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,730 copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,733 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,735 copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,737 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,740 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,742 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,745 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,748 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,750 copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,751 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,753 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,755 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,757 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,758 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,760 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2025-11-27T00:43:42,763 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include 2025-11-27T00:43:42,764 copying build/lib/lm_eval/tasks/include/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include 2025-11-27T00:43:42,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default 2025-11-27T00:43:42,768 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,769 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,771 copying build/lib/lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,773 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,775 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,777 copying build/lib/lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,779 copying build/lib/lm_eval/tasks/include/default/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2025-11-27T00:43:42,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,783 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,785 copying build/lib/lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,787 copying build/lib/lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,789 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,791 copying build/lib/lm_eval/tasks/include/default/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,792 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,794 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2025-11-27T00:43:42,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Basque 2025-11-27T00:43:42,798 copying build/lib/lm_eval/tasks/include/default/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2025-11-27T00:43:42,799 copying build/lib/lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2025-11-27T00:43:42,801 copying build/lib/lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2025-11-27T00:43:42,803 copying build/lib/lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2025-11-27T00:43:42,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:42,806 copying build/lib/lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:42,808 copying build/lib/lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:42,810 copying build/lib/lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:42,812 copying build/lib/lm_eval/tasks/include/default/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2025-11-27T00:43:42,815 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,816 copying build/lib/lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,818 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,820 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,822 copying build/lib/lm_eval/tasks/include/default/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,824 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,826 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,827 copying build/lib/lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,829 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,831 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2025-11-27T00:43:42,834 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,835 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,837 copying build/lib/lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,838 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,840 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,842 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,844 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,846 copying build/lib/lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,847 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,849 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,851 copying build/lib/lm_eval/tasks/include/default/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,853 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2025-11-27T00:43:42,855 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,856 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,858 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,860 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,862 copying build/lib/lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,864 copying build/lib/lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,866 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,868 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,870 copying build/lib/lm_eval/tasks/include/default/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,871 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,874 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2025-11-27T00:43:42,876 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,877 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,879 copying build/lib/lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,881 copying build/lib/lm_eval/tasks/include/default/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,883 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,884 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,886 copying build/lib/lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2025-11-27T00:43:42,888 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,890 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,892 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,893 copying build/lib/lm_eval/tasks/include/default/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,895 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,897 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,899 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2025-11-27T00:43:42,902 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,903 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,905 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,907 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,909 copying build/lib/lm_eval/tasks/include/default/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,911 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,913 copying build/lib/lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,915 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,917 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,919 copying build/lib/lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2025-11-27T00:43:42,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,922 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,924 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,926 copying build/lib/lm_eval/tasks/include/default/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,928 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,930 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,932 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2025-11-27T00:43:42,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,936 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,938 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,940 copying build/lib/lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,942 copying build/lib/lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,944 copying build/lib/lm_eval/tasks/include/default/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,946 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,947 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,949 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2025-11-27T00:43:42,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,953 copying build/lib/lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,955 copying build/lib/lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,957 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,959 copying build/lib/lm_eval/tasks/include/default/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,961 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,963 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2025-11-27T00:43:42,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,966 copying build/lib/lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,968 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,970 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,972 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,973 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,975 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,977 copying build/lib/lm_eval/tasks/include/default/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,979 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,981 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,983 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,985 copying build/lib/lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2025-11-27T00:43:42,987 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,988 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,990 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,992 copying build/lib/lm_eval/tasks/include/default/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,994 copying build/lib/lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,996 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:42,998 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:43,000 copying build/lib/lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:43,001 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2025-11-27T00:43:43,004 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,005 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,007 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,009 copying build/lib/lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,010 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,012 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,014 copying build/lib/lm_eval/tasks/include/default/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,016 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,017 copying build/lib/lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,019 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,021 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,023 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2025-11-27T00:43:43,026 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,027 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,031 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,032 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,034 copying build/lib/lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,036 copying build/lib/lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,038 copying build/lib/lm_eval/tasks/include/default/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2025-11-27T00:43:43,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,042 copying build/lib/lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,044 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,046 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,048 copying build/lib/lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,049 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,051 copying build/lib/lm_eval/tasks/include/default/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,053 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,055 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2025-11-27T00:43:43,057 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,058 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,060 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,062 copying build/lib/lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,064 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,066 copying build/lib/lm_eval/tasks/include/default/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,067 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,069 copying build/lib/lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2025-11-27T00:43:43,072 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,073 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,075 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,077 copying build/lib/lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,079 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,081 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,082 copying build/lib/lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,084 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,086 copying build/lib/lm_eval/tasks/include/default/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2025-11-27T00:43:43,089 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,090 copying build/lib/lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,092 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,094 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,096 copying build/lib/lm_eval/tasks/include/default/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,098 copying build/lib/lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,099 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,101 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,103 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,105 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2025-11-27T00:43:43,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,108 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,110 copying build/lib/lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,111 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,113 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,115 copying build/lib/lm_eval/tasks/include/default/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,117 copying build/lib/lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,118 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2025-11-27T00:43:43,121 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,122 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,124 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,126 copying build/lib/lm_eval/tasks/include/default/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,127 copying build/lib/lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,129 copying build/lib/lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2025-11-27T00:43:43,131 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,132 copying build/lib/lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,134 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,135 copying build/lib/lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,137 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,139 copying build/lib/lm_eval/tasks/include/default/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2025-11-27T00:43:43,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,142 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,144 copying build/lib/lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,146 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,148 copying build/lib/lm_eval/tasks/include/default/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,149 copying build/lib/lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2025-11-27T00:43:43,152 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,153 copying build/lib/lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,155 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,157 copying build/lib/lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,159 copying build/lib/lm_eval/tasks/include/default/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,161 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,162 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2025-11-27T00:43:43,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,166 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,168 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,170 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,172 copying build/lib/lm_eval/tasks/include/default/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,173 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,175 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,177 copying build/lib/lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,178 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,180 copying build/lib/lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2025-11-27T00:43:43,182 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,183 copying build/lib/lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,185 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,187 copying build/lib/lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,189 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,190 copying build/lib/lm_eval/tasks/include/default/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,192 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2025-11-27T00:43:43,195 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:43,196 copying build/lib/lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:43,198 copying build/lib/lm_eval/tasks/include/default/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:43,199 copying build/lib/lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:43,201 copying build/lib/lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2025-11-27T00:43:43,203 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,204 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,206 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,208 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,210 copying build/lib/lm_eval/tasks/include/default/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,212 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,214 copying build/lib/lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,215 copying build/lib/lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2025-11-27T00:43:43,217 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,219 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,221 copying build/lib/lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,222 copying build/lib/lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,224 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,226 copying build/lib/lm_eval/tasks/include/default/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,227 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,229 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2025-11-27T00:43:43,232 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,233 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,234 copying build/lib/lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,236 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,238 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,240 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,242 copying build/lib/lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,244 copying build/lib/lm_eval/tasks/include/default/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,246 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2025-11-27T00:43:43,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,249 copying build/lib/lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,251 copying build/lib/lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,253 copying build/lib/lm_eval/tasks/include/default/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,255 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,256 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,258 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2025-11-27T00:43:43,260 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,261 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,263 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,265 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,267 copying build/lib/lm_eval/tasks/include/default/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,269 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,271 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2025-11-27T00:43:43,273 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,274 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,276 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,278 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,280 copying build/lib/lm_eval/tasks/include/default/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,282 copying build/lib/lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,284 copying build/lib/lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2025-11-27T00:43:43,286 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,287 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,289 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,291 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,293 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,294 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,296 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,298 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,299 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,301 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2025-11-27T00:43:43,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,305 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,306 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,308 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,310 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,312 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,314 copying build/lib/lm_eval/tasks/include/default/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,316 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2025-11-27T00:43:43,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,319 copying build/lib/lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,321 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,323 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,325 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,326 copying build/lib/lm_eval/tasks/include/default/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,329 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,330 copying build/lib/lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2025-11-27T00:43:43,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/German 2025-11-27T00:43:43,334 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,335 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,337 copying build/lib/lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,339 copying build/lib/lm_eval/tasks/include/default/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,341 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,343 copying build/lib/lm_eval/tasks/include/default/German/_german_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2025-11-27T00:43:43,345 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,346 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,348 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,350 copying build/lib/lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,352 copying build/lib/lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,354 copying build/lib/lm_eval/tasks/include/default/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2025-11-27T00:43:43,356 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,357 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,359 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,361 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,362 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,364 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,366 copying build/lib/lm_eval/tasks/include/default/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,368 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,370 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2025-11-27T00:43:43,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/French 2025-11-27T00:43:43,373 copying build/lib/lm_eval/tasks/include/default/French/_french_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,375 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,376 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,378 copying build/lib/lm_eval/tasks/include/default/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,380 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,382 copying build/lib/lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,384 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,385 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2025-11-27T00:43:43,388 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,389 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,391 copying build/lib/lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,392 copying build/lib/lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,394 copying build/lib/lm_eval/tasks/include/default/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,396 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2025-11-27T00:43:43,398 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,399 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,401 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,403 copying build/lib/lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,405 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,407 copying build/lib/lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,408 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,410 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,412 copying build/lib/lm_eval/tasks/include/default/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2025-11-27T00:43:43,415 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og 2025-11-27T00:43:43,417 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,418 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,420 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,422 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,424 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,425 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,427 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2025-11-27T00:43:43,430 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,431 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,433 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,434 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,436 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,438 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,440 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,442 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2025-11-27T00:43:43,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:43,445 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:43,447 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:43,449 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:43,451 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2025-11-27T00:43:43,454 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:43,455 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:43,456 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:43,458 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:43,460 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2025-11-27T00:43:43,462 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,463 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,465 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,467 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,469 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,470 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,472 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,474 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,476 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,478 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2025-11-27T00:43:43,480 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,481 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,483 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,485 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,487 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,489 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,491 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,493 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,494 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,496 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,498 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,500 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2025-11-27T00:43:43,502 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,503 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,505 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,507 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,509 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,510 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,512 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,514 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,516 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,517 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,519 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2025-11-27T00:43:43,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,522 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,524 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,526 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,528 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,530 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,532 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2025-11-27T00:43:43,534 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,535 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,537 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,539 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,540 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,542 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,544 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2025-11-27T00:43:43,546 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,547 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,549 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,551 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,553 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,555 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,556 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,558 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,560 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,562 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2025-11-27T00:43:43,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,566 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,568 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,570 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,571 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,573 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,575 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2025-11-27T00:43:43,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,579 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,581 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,582 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,584 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,586 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,588 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,590 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,592 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2025-11-27T00:43:43,594 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,595 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,597 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,599 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,601 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,603 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,605 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2025-11-27T00:43:43,608 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,609 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,611 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,612 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,614 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,616 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,618 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,620 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,622 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,624 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,625 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,627 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2025-11-27T00:43:43,629 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,630 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,633 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,634 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,636 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,638 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,640 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,642 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,644 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2025-11-27T00:43:43,646 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,647 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,649 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,651 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,653 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,655 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,657 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,659 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,660 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,662 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,664 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,666 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2025-11-27T00:43:43,669 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,670 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,672 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,674 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,676 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,678 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,679 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2025-11-27T00:43:43,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,683 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,685 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,687 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,692 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,694 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,695 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,697 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,699 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2025-11-27T00:43:43,701 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,702 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,704 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,706 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,708 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,710 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,712 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,714 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2025-11-27T00:43:43,716 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,717 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,719 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,721 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,723 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,725 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,727 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,729 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,731 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2025-11-27T00:43:43,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,734 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,736 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,738 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,740 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,742 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,743 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,746 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,747 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,749 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2025-11-27T00:43:43,752 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,753 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,755 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,757 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,759 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,761 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,763 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,765 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2025-11-27T00:43:43,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,768 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,770 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,772 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,774 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,776 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2025-11-27T00:43:43,779 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,780 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,782 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,784 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,785 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,787 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2025-11-27T00:43:43,790 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,792 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,794 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,797 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,799 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,801 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2025-11-27T00:43:43,804 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,806 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,808 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,811 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,813 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,815 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,818 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2025-11-27T00:43:43,821 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,823 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,826 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,828 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,830 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,833 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,835 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,837 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,840 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,842 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2025-11-27T00:43:43,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,847 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,849 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,851 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,854 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,856 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,859 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2025-11-27T00:43:43,862 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:43,863 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:43,866 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:43,868 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:43,871 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2025-11-27T00:43:43,874 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,875 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,878 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,880 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,883 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,885 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,887 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,890 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2025-11-27T00:43:43,892 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,893 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,895 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,897 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,899 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,901 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,903 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,905 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2025-11-27T00:43:43,907 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,908 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,911 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,913 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,914 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,916 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,919 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,920 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,922 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2025-11-27T00:43:43,924 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,925 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,927 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,929 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,932 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,934 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,935 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2025-11-27T00:43:43,938 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,939 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,941 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,943 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,945 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,947 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,949 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2025-11-27T00:43:43,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,953 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,955 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,957 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,959 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,961 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,963 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2025-11-27T00:43:43,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,966 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,969 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,970 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,972 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,974 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,976 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,978 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,980 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,982 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2025-11-27T00:43:43,984 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,985 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,987 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,990 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,991 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,993 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,995 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:43,998 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2025-11-27T00:43:44,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,001 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,003 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,005 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,007 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,009 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,011 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,013 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2025-11-27T00:43:44,015 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,016 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,018 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,020 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,022 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,024 copying build/lib/lm_eval/tasks/include/few_shot_og/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,026 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2025-11-27T00:43:44,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,029 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,031 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,034 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,035 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,037 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2025-11-27T00:43:44,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,041 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,043 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,045 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,047 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,049 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,051 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,052 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,054 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2025-11-27T00:43:44,057 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,058 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,060 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,062 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,064 copying build/lib/lm_eval/tasks/include/few_shot_og/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,066 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,069 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,070 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,072 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2025-11-27T00:43:44,075 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,076 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,078 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,080 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,082 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,084 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2025-11-27T00:43:44,087 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,088 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,090 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,092 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,094 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,095 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,097 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,099 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,101 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2025-11-27T00:43:44,104 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en 2025-11-27T00:43:44,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,107 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,109 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,111 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,113 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,115 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,117 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2025-11-27T00:43:44,120 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,121 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,123 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,125 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,127 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,129 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,131 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,132 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2025-11-27T00:43:44,135 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:44,136 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:44,139 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:44,140 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:44,143 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2025-11-27T00:43:44,145 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:44,146 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:44,148 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:44,150 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:44,152 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2025-11-27T00:43:44,155 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,156 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,158 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,160 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,161 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,163 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,165 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,167 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,169 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,171 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2025-11-27T00:43:44,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,175 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,177 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,178 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,180 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,182 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,184 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,186 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,188 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,190 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,192 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,194 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2025-11-27T00:43:44,196 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,198 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,200 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,202 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,204 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,206 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,208 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,210 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,212 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,213 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,215 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2025-11-27T00:43:44,218 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,219 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,221 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,223 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,225 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,226 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,228 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2025-11-27T00:43:44,231 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,232 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,234 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,236 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,238 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,240 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,241 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2025-11-27T00:43:44,244 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,245 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,247 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,249 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,251 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,253 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,255 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,257 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,258 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,260 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2025-11-27T00:43:44,263 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,264 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,266 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,268 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,270 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,272 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,274 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2025-11-27T00:43:44,276 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,278 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,280 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,282 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,284 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,286 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,287 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,290 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,292 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2025-11-27T00:43:44,294 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,295 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,298 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,300 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,302 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,305 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,307 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2025-11-27T00:43:44,310 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,311 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,314 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,316 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,318 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,320 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,322 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,324 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,326 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,328 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,330 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,332 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2025-11-27T00:43:44,334 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,335 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,337 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,339 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,340 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,342 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,344 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,346 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,347 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2025-11-27T00:43:44,350 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,351 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,353 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,355 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,357 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,359 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,360 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,362 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,364 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,366 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,368 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,370 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2025-11-27T00:43:44,373 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,374 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,376 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,379 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,380 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,382 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,384 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2025-11-27T00:43:44,386 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,387 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,389 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,391 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,393 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,395 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,396 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,398 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,400 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2025-11-27T00:43:44,402 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,403 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,405 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,407 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,409 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,411 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,413 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,415 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2025-11-27T00:43:44,417 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,418 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,420 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,421 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,423 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,425 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,426 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,428 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,430 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2025-11-27T00:43:44,432 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,433 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,435 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,437 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,439 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,440 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,442 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,444 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,446 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,448 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2025-11-27T00:43:44,451 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,452 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,454 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,456 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,458 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,459 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,461 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,463 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2025-11-27T00:43:44,465 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,466 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,469 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,470 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,472 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,474 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2025-11-27T00:43:44,476 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,478 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,480 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,482 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,483 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,485 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2025-11-27T00:43:44,488 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,489 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,491 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,493 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,495 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,497 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2025-11-27T00:43:44,499 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,500 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,502 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,504 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,506 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,508 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,510 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2025-11-27T00:43:44,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,513 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,515 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,518 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,520 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,521 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,523 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,525 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,527 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,529 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2025-11-27T00:43:44,531 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,532 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,534 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,536 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,538 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,539 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,541 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2025-11-27T00:43:44,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:44,545 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:44,546 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:44,548 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:44,550 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2025-11-27T00:43:44,553 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,554 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,556 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,558 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,559 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,561 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,563 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,565 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2025-11-27T00:43:44,567 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,568 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,571 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,572 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,574 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,576 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,578 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,580 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2025-11-27T00:43:44,582 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,583 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,585 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,587 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,589 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,591 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,593 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,595 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,597 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2025-11-27T00:43:44,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,600 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,602 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,604 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,606 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,608 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,610 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2025-11-27T00:43:44,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,614 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,616 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,618 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,619 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,621 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,623 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2025-11-27T00:43:44,625 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,627 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,629 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,630 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,632 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,634 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,636 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2025-11-27T00:43:44,639 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,640 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,642 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,644 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,646 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,648 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,650 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,652 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,654 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,656 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2025-11-27T00:43:44,658 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,659 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,661 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,663 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,665 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,667 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,669 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,671 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2025-11-27T00:43:44,673 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,674 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,676 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,678 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,680 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,682 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,684 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,686 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2025-11-27T00:43:44,688 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,689 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,691 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,693 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,695 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,697 copying build/lib/lm_eval/tasks/include/few_shot_en/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,699 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2025-11-27T00:43:44,701 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,702 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,704 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,706 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,708 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,710 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2025-11-27T00:43:44,712 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,713 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,715 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,717 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,719 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,721 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,723 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,724 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,726 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2025-11-27T00:43:44,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,730 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,732 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,734 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,736 copying build/lib/lm_eval/tasks/include/few_shot_en/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,738 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,740 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,742 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,744 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2025-11-27T00:43:44,746 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,747 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,750 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,751 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,753 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,755 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2025-11-27T00:43:44,757 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,759 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,761 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,763 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,765 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,767 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,769 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,771 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,773 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2025-11-27T00:43:44,776 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa 2025-11-27T00:43:44,777 copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,779 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,781 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,783 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,785 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,786 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,788 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,790 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,792 copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,794 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,796 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,797 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,800 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,802 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,804 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,806 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,809 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,811 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2025-11-27T00:43:44,814 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/careqa 2025-11-27T00:43:44,815 copying build/lib/lm_eval/tasks/careqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,817 copying build/lib/lm_eval/tasks/careqa/careqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,819 copying build/lib/lm_eval/tasks/careqa/careqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,821 copying build/lib/lm_eval/tasks/careqa/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,823 copying build/lib/lm_eval/tasks/careqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,825 copying build/lib/lm_eval/tasks/careqa/utils_open.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,827 copying build/lib/lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,829 copying build/lib/lm_eval/tasks/careqa/careqa_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2025-11-27T00:43:44,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile 2025-11-27T00:43:44,833 copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,835 copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,837 copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,839 copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,842 copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,844 copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,846 copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,848 copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,850 copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,852 copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,854 copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,856 copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,858 copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,860 copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,861 copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,863 copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,865 copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,867 copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,869 copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,870 copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,872 copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,874 copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,876 copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2025-11-27T00:43:44,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa 2025-11-27T00:43:44,879 copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa 2025-11-27T00:43:44,882 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,883 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,886 copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,887 copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,889 copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,891 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,893 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2025-11-27T00:43:44,896 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,897 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,899 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,901 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,903 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,905 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,907 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2025-11-27T00:43:44,909 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,910 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,912 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,914 copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,916 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,918 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,920 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2025-11-27T00:43:44,923 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,924 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,926 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,928 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,929 copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,931 copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,933 copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2025-11-27T00:43:44,936 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,937 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,939 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,941 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,943 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,945 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,947 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2025-11-27T00:43:44,949 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mbpp 2025-11-27T00:43:44,950 copying build/lib/lm_eval/tasks/mbpp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,952 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,954 copying build/lib/lm_eval/tasks/mbpp/mbpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,956 copying build/lib/lm_eval/tasks/mbpp/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,958 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,960 copying build/lib/lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2025-11-27T00:43:44,963 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,964 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,966 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,968 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,969 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,971 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,973 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,975 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,976 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2025-11-27T00:43:44,979 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,980 copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,982 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,984 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,985 copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,988 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2025-11-27T00:43:44,990 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts 2025-11-27T00:43:44,992 copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2025-11-27T00:43:44,994 copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2025-11-27T00:43:44,996 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa 2025-11-27T00:43:44,998 copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2025-11-27T00:43:45,000 copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2025-11-27T00:43:45,002 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,003 copying build/lib/lm_eval/tasks/jsonschema_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,006 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,008 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,010 copying build/lib/lm_eval/tasks/jsonschema_bench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,012 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2025-11-27T00:43:45,015 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench 2025-11-27T00:43:45,016 copying build/lib/lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,018 copying build/lib/lm_eval/tasks/longbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,020 copying build/lib/lm_eval/tasks/longbench/repobench-p_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,022 copying build/lib/lm_eval/tasks/longbench/_longbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,024 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,026 copying build/lib/lm_eval/tasks/longbench/trec_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,028 copying build/lib/lm_eval/tasks/longbench/multi_news_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,030 copying build/lib/lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,032 copying build/lib/lm_eval/tasks/longbench/lcc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,034 copying build/lib/lm_eval/tasks/longbench/dureader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,036 copying build/lib/lm_eval/tasks/longbench/lcc_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,038 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,040 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,042 copying build/lib/lm_eval/tasks/longbench/gov_report.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,044 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,046 copying build/lib/lm_eval/tasks/longbench/_longbench_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,048 copying build/lib/lm_eval/tasks/longbench/qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,050 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,052 copying build/lib/lm_eval/tasks/longbench/vcsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,054 copying build/lib/lm_eval/tasks/longbench/passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,056 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,058 copying build/lib/lm_eval/tasks/longbench/hotpotqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,059 copying build/lib/lm_eval/tasks/longbench/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,062 copying build/lib/lm_eval/tasks/longbench/narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,063 copying build/lib/lm_eval/tasks/longbench/musique.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,065 copying build/lib/lm_eval/tasks/longbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,067 copying build/lib/lm_eval/tasks/longbench/gov_report_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,069 copying build/lib/lm_eval/tasks/longbench/repobench-p.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,070 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,072 copying build/lib/lm_eval/tasks/longbench/trec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,074 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,076 copying build/lib/lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,077 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,079 copying build/lib/lm_eval/tasks/longbench/passage_count_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,081 copying build/lib/lm_eval/tasks/longbench/multi_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,083 copying build/lib/lm_eval/tasks/longbench/lsht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,085 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,087 copying build/lib/lm_eval/tasks/longbench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,089 copying build/lib/lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,091 copying build/lib/lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,093 copying build/lib/lm_eval/tasks/longbench/_longbench_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,095 copying build/lib/lm_eval/tasks/longbench/samsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,097 copying build/lib/lm_eval/tasks/longbench/2wikimqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,099 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,101 copying build/lib/lm_eval/tasks/longbench/_longbench_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,102 copying build/lib/lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,104 copying build/lib/lm_eval/tasks/longbench/qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,106 copying build/lib/lm_eval/tasks/longbench/samsum_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,108 copying build/lib/lm_eval/tasks/longbench/qasper_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,110 copying build/lib/lm_eval/tasks/longbench/triviaqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,112 copying build/lib/lm_eval/tasks/longbench/_longbench_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,114 copying build/lib/lm_eval/tasks/longbench/triviaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2025-11-27T00:43:45,116 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia 2025-11-27T00:43:45,117 copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2025-11-27T00:43:45,119 copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2025-11-27T00:43:45,121 copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2025-11-27T00:43:45,124 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams 2025-11-27T00:43:45,125 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,127 copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,129 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,131 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,133 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,135 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,136 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,138 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,140 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,142 copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,143 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,145 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,147 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,149 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,150 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,152 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,154 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,156 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,157 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,159 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,160 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,162 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,164 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,166 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,168 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,169 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,171 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,173 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,175 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,177 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,178 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,180 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,182 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,184 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,185 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,187 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,189 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,191 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,193 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,195 copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,196 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,198 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,200 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,202 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,204 copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,206 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,207 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,209 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,211 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,213 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,215 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,216 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,218 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,220 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,222 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,223 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,225 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,227 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,229 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,231 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,233 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,234 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,236 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,238 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,240 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,242 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,244 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,246 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2025-11-27T00:43:45,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench 2025-11-27T00:43:45,250 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,252 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,254 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,255 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,257 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,259 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,261 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,263 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,265 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,267 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,269 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,271 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,272 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,274 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,276 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,278 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,280 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,282 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,284 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,286 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2025-11-27T00:43:45,288 copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2025-11-27T00:43:45,290 copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2025-11-27T00:43:45,292 copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2025-11-27T00:43:45,294 copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2025-11-27T00:43:45,296 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/graphwalks 2025-11-27T00:43:45,297 copying build/lib/lm_eval/tasks/graphwalks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2025-11-27T00:43:45,299 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2025-11-27T00:43:45,301 copying build/lib/lm_eval/tasks/graphwalks/graphwalks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2025-11-27T00:43:45,303 copying build/lib/lm_eval/tasks/graphwalks/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2025-11-27T00:43:45,305 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2025-11-27T00:43:45,307 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,308 copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,310 copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,313 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,314 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,316 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,318 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,320 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,322 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,324 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,326 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,328 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,330 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,332 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,335 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,337 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,339 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,342 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,344 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,346 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,349 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,351 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,353 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2025-11-27T00:43:45,355 copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,356 copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,358 copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,360 copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:45,364 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:45,366 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:45,368 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2025-11-27T00:43:45,369 copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,371 copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,373 copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,375 copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,377 copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,379 copying build/lib/lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2025-11-27T00:43:45,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,383 copying build/lib/lm_eval/tasks/mimic_repsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,385 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,387 copying build/lib/lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,389 copying build/lib/lm_eval/tasks/mimic_repsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,391 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2025-11-27T00:43:45,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual 2025-11-27T00:43:45,395 copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2025-11-27T00:43:45,397 copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2025-11-27T00:43:45,399 copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2025-11-27T00:43:45,401 copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2025-11-27T00:43:45,403 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation 2025-11-27T00:43:45,404 copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,406 copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,408 copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,410 copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,412 copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,413 copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,415 copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,417 copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,419 copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,421 copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,423 copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2025-11-27T00:43:45,427 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele 2025-11-27T00:43:45,429 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,430 copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,432 copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,434 copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,436 copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,439 copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,441 copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,442 copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,444 copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,446 copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,448 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,450 copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,452 copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,454 copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,456 copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,458 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,459 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,461 copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,463 copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,465 copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,467 copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,469 copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,470 copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,472 copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,474 copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,476 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,478 copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,479 copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,481 copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,483 copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,485 copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,487 copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,489 copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,491 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,493 copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,495 copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,496 copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,498 copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,500 copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,502 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,504 copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,506 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,508 copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,510 copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,512 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,513 copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,515 copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,517 copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,519 copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,520 copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,522 copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,524 copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,526 copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,528 copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,530 copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,531 copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,533 copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,535 copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,538 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,540 copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,542 copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,543 copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,545 copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,547 copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,549 copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,551 copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,553 copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,555 copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,557 copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,559 copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,561 copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,562 copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,564 copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,566 copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,568 copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,570 copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,572 copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,574 copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,575 copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,577 copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,579 copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,581 copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,583 copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,585 copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,586 copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,588 copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,590 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,592 copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,594 copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,597 copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,598 copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,600 copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,602 copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,604 copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,606 copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,608 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,610 copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,612 copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,614 copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,616 copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,618 copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,619 copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,621 copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,623 copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,625 copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,627 copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,629 copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,631 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,632 copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,634 copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,636 copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,638 copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,640 copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,642 copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,644 copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,646 copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,648 copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,650 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,651 copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,653 copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,655 copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,657 copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,659 copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,661 copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,663 copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,665 copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2025-11-27T00:43:45,667 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,668 copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,670 copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,672 copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,674 copying build/lib/lm_eval/tasks/afrimgsm/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,676 copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2025-11-27T00:43:45,679 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct 2025-11-27T00:43:45,681 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,682 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,684 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,686 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,688 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,689 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,691 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,693 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,695 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,697 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,699 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,701 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,703 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,705 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,707 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,709 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,711 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,712 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,715 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,716 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,718 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2025-11-27T00:43:45,721 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,722 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,724 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,726 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,728 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,730 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,732 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,734 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,735 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,737 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,739 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,741 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,743 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,745 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,747 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,749 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,750 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,752 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,754 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,756 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,758 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2025-11-27T00:43:45,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,762 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,764 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,766 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,767 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,769 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,771 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,773 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,775 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,776 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,778 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,780 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,782 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,784 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,786 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,787 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,789 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,791 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,793 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,795 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,797 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2025-11-27T00:43:45,798 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2025-11-27T00:43:45,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,802 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,804 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,806 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,808 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,810 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,811 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,813 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,815 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,817 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,819 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,821 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,822 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,824 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,826 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,828 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,830 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,831 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,833 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,835 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,837 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2025-11-27T00:43:45,840 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,841 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,843 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,845 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,847 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,849 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,851 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,853 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,855 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,857 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,859 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,861 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,863 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,864 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,866 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,868 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,870 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,872 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,874 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,876 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,878 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2025-11-27T00:43:45,880 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate 2025-11-27T00:43:45,882 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,883 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,885 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,887 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,889 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,891 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,893 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,895 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,897 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,899 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,900 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,902 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,904 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,906 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,908 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,910 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,912 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,913 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,915 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2025-11-27T00:43:45,918 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,920 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,922 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,924 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,926 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,928 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,930 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,932 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,934 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,936 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,938 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,940 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,942 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,943 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,945 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,947 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,949 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,951 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,953 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2025-11-27T00:43:45,955 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,956 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,958 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,960 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,962 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,964 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,967 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,969 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,971 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,973 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,975 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,977 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,978 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,980 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,982 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,984 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,986 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,987 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,989 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2025-11-27T00:43:45,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:45,993 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:45,995 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:45,997 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,000 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,002 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,004 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,006 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,009 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,011 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,013 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,014 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,016 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,018 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,020 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,022 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,024 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,026 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,028 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2025-11-27T00:43:46,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,031 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,033 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,035 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,037 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,039 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,042 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,044 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,046 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,048 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,051 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,053 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,055 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,057 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,059 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,061 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,062 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,064 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,066 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2025-11-27T00:43:46,067 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2025-11-27T00:43:46,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot 2025-11-27T00:43:46,071 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,072 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,074 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,076 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,078 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,080 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,082 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,084 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,086 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,087 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,089 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,091 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,093 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,095 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,097 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,099 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,101 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,103 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,105 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,106 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2025-11-27T00:43:46,109 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,110 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,112 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,114 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,116 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,117 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,119 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,121 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,123 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,125 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,126 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,128 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,130 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,132 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,134 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,136 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,138 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,140 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,142 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,144 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2025-11-27T00:43:46,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,147 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,149 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,151 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,153 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,155 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,157 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,159 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,160 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,162 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,164 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,166 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,168 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,170 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,172 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,173 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,175 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,177 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,180 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,182 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2025-11-27T00:43:46,183 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot 2025-11-27T00:43:46,186 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,187 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,189 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,191 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,193 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,194 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,196 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,198 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,200 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,202 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,204 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,206 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,208 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,210 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,211 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,213 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,215 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,217 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,219 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,221 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2025-11-27T00:43:46,223 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,224 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,226 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,228 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,230 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,232 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,234 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,236 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,237 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,239 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,241 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,243 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,245 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,246 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,248 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,250 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,252 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,253 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,255 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,257 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2025-11-27T00:43:46,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot 2025-11-27T00:43:46,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,262 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,264 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,266 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,268 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,270 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,272 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,273 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,275 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,277 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,279 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,281 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,283 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,285 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,287 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,289 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,291 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,292 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,294 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,296 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,298 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2025-11-27T00:43:46,301 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,302 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,304 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,306 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,308 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,309 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,311 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,313 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,315 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,317 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,319 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,321 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,322 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,324 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,326 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,328 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,330 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,332 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,334 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,336 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,338 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2025-11-27T00:43:46,340 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,342 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,344 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,345 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,347 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,349 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,351 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,353 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,355 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,357 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,358 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,360 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,362 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,364 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,366 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,368 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,370 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,371 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,373 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,375 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,377 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2025-11-27T00:43:46,379 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot 2025-11-27T00:43:46,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,383 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,385 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,387 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,389 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,391 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,392 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,394 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,396 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,398 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,400 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,402 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,403 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,405 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,407 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,409 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,411 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,413 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,415 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,417 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,419 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2025-11-27T00:43:46,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,423 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,425 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,427 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,429 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,430 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,432 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,434 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,436 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,438 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,440 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,442 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,444 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,445 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,447 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,449 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,451 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,453 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,455 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,457 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,459 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2025-11-27T00:43:46,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag 2025-11-27T00:43:46,463 copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2025-11-27T00:43:46,465 copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2025-11-27T00:43:46,467 copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2025-11-27T00:43:46,470 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt 2025-11-27T00:43:46,471 copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,473 copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,475 copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,476 copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,478 copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,480 copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,481 copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,483 copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,485 copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,486 copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,488 copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,490 copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,492 copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,494 copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,495 copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,497 copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,499 copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,501 copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,502 copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,504 copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,506 copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,507 copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,510 copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2025-11-27T00:43:46,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_text_classification 2025-11-27T00:43:46,513 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2025-11-27T00:43:46,515 copying build/lib/lm_eval/tasks/med_text_classification/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2025-11-27T00:43:46,517 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2025-11-27T00:43:46,519 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost 2025-11-27T00:43:46,520 copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2025-11-27T00:43:46,522 copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2025-11-27T00:43:46,524 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa 2025-11-27T00:43:46,525 copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2025-11-27T00:43:46,527 copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2025-11-27T00:43:46,529 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/groundcocoa 2025-11-27T00:43:46,530 copying build/lib/lm_eval/tasks/groundcocoa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2025-11-27T00:43:46,532 copying build/lib/lm_eval/tasks/groundcocoa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2025-11-27T00:43:46,534 copying build/lib/lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2025-11-27T00:43:46,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,537 copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,539 copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,541 copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,543 copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,544 copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,546 copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,548 copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,550 copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,551 copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,553 copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,555 copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,557 copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,558 copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2025-11-27T00:43:46,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu 2025-11-27T00:43:46,563 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,564 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,566 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,568 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,569 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,571 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,573 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,575 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,576 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,578 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,580 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,582 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,583 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,585 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,587 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,589 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,590 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,592 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,594 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,596 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,597 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,599 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,601 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,602 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,604 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,606 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,607 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,609 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,611 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,613 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,614 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,616 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,618 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,619 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,621 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,623 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,624 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,626 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,628 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,630 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,631 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,633 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,635 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,637 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,639 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,640 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,642 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,644 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,646 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,647 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,649 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,651 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2025-11-27T00:43:46,653 copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu 2025-11-27T00:43:46,656 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,657 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,659 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,660 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,662 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,664 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,665 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,667 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,669 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,670 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,672 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,674 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,675 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,677 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,679 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,680 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,682 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,684 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,685 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,687 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,689 copying build/lib/lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,690 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,692 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,694 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,696 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,697 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,699 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,701 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,702 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,704 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,705 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,707 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,709 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,710 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,712 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,714 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,715 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,717 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,719 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,721 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,722 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,724 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,726 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,728 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,730 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,731 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,733 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,735 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,737 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,739 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,741 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,742 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2025-11-27T00:43:46,745 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,746 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,748 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,750 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,751 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,753 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,755 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,756 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,758 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,760 copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,762 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,763 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,765 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,767 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,769 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,770 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,772 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,774 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,776 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,777 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,779 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,781 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,783 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,785 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,786 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,788 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,790 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,792 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,794 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,795 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,797 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,799 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,800 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,802 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,804 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,805 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,807 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,809 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,810 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,812 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,814 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,816 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,817 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,819 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,821 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,822 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,824 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,826 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,828 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,830 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,831 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,833 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2025-11-27T00:43:46,836 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,837 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,839 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,841 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,844 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,846 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,848 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,850 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,852 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,854 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,856 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,859 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,861 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,863 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,865 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,867 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,870 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,872 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,875 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,877 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,879 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,881 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,883 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,885 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,887 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,890 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,892 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,894 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,896 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,899 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,900 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,903 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,905 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,907 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,910 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,912 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,914 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,916 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,919 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,921 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,923 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,926 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,928 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,930 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,933 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,935 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,937 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,939 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,941 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,943 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,945 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,948 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2025-11-27T00:43:46,951 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,952 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,954 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,956 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,958 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,960 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,961 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,963 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,965 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,966 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,968 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,970 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,972 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,973 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,975 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,977 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,979 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,980 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,982 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,984 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,986 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,987 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,989 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,991 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,993 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,995 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,996 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:46,998 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,000 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,002 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,004 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,006 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,008 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,009 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,011 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,013 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,015 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,016 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,018 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,020 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,022 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,024 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,025 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,027 copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,029 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,031 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,033 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,034 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,036 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,038 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,040 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,042 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2025-11-27T00:43:47,044 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly 2025-11-27T00:43:47,045 copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,047 copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,049 copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,051 copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,053 copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,055 copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2025-11-27T00:43:47,057 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/c4 2025-11-27T00:43:47,058 copying build/lib/lm_eval/tasks/c4/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2025-11-27T00:43:47,060 copying build/lib/lm_eval/tasks/c4/preprocess_c4.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2025-11-27T00:43:47,062 copying build/lib/lm_eval/tasks/c4/c4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2025-11-27T00:43:47,065 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,066 copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,068 copying build/lib/lm_eval/tasks/kormedmcqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,070 copying build/lib/lm_eval/tasks/kormedmcqa/pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,072 copying build/lib/lm_eval/tasks/kormedmcqa/dentist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,073 copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,075 copying build/lib/lm_eval/tasks/kormedmcqa/doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,077 copying build/lib/lm_eval/tasks/kormedmcqa/nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2025-11-27T00:43:47,079 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,080 copying build/lib/lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,082 copying build/lib/lm_eval/tasks/humaneval_infilling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,084 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,085 copying build/lib/lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,087 copying build/lib/lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,089 copying build/lib/lm_eval/tasks/humaneval_infilling/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,091 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2025-11-27T00:43:47,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mastermind 2025-11-27T00:43:47,094 copying build/lib/lm_eval/tasks/mastermind/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,096 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,098 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,100 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,101 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,103 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,105 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2025-11-27T00:43:47,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams 2025-11-27T00:43:47,108 copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,110 copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,112 copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,114 copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,116 copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,118 copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,120 copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,121 copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2025-11-27T00:43:47,124 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop 2025-11-27T00:43:47,125 copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2025-11-27T00:43:47,127 copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2025-11-27T00:43:47,128 copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2025-11-27T00:43:47,131 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bhs 2025-11-27T00:43:47,132 copying build/lib/lm_eval/tasks/bhs/bhs_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,134 copying build/lib/lm_eval/tasks/bhs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,136 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,138 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,140 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,141 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,143 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,145 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,147 copying build/lib/lm_eval/tasks/bhs/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,149 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,150 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,152 copying build/lib/lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,154 copying build/lib/lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,156 copying build/lib/lm_eval/tasks/bhs/bhs_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,157 copying build/lib/lm_eval/tasks/bhs/bhs_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,159 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,161 copying build/lib/lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,163 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,165 copying build/lib/lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,168 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,169 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,171 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,173 copying build/lib/lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,175 copying build/lib/lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,177 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,178 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,180 copying build/lib/lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2025-11-27T00:43:47,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/discrim_eval 2025-11-27T00:43:47,184 copying build/lib/lm_eval/tasks/discrim_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2025-11-27T00:43:47,185 copying build/lib/lm_eval/tasks/discrim_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2025-11-27T00:43:47,187 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2025-11-27T00:43:47,189 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2025-11-27T00:43:47,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda 2025-11-27T00:43:47,193 copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2025-11-27T00:43:47,195 copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2025-11-27T00:43:47,197 copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2025-11-27T00:43:47,200 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh 2025-11-27T00:43:47,201 copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2025-11-27T00:43:47,204 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,205 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,208 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,210 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,212 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,213 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,215 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,217 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,219 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,221 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,223 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,224 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,226 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,228 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,230 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,232 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,233 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,236 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,237 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,239 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,241 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,243 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,245 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,246 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,248 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,250 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,252 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,254 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,255 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,257 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,259 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2025-11-27T00:43:47,262 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,263 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,265 copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,267 copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,269 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,271 copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,273 copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,274 copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,276 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,279 copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,281 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,283 copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,285 copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,287 copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,290 copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,292 copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,294 copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,296 copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,298 copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,300 copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,302 copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,304 copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,306 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,308 copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,309 copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,311 copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,313 copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,315 copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,317 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,319 copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2025-11-27T00:43:47,322 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,323 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,325 copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,326 copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,328 copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,330 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,332 copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,334 copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,335 copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,337 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,339 copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,340 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,342 copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,344 copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,346 copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,347 copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,350 copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,351 copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,353 copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,355 copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,357 copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,358 copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,360 copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,362 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,364 copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,366 copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,367 copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,369 copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,371 copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,373 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,374 copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2025-11-27T00:43:47,376 copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2025-11-27T00:43:47,379 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,380 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,383 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,385 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,387 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,389 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,391 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,393 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,396 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,398 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,400 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,402 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,404 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,406 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,408 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,410 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,412 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,414 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,417 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,419 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,422 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,424 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,426 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,429 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,431 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,434 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,436 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,439 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,441 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,444 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,446 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2025-11-27T00:43:47,450 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egymmlu 2025-11-27T00:43:47,452 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,454 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,456 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,459 copying build/lib/lm_eval/tasks/egymmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,461 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,463 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,465 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,467 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,470 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,472 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,474 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,476 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,478 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,480 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,482 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,485 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,487 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,489 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,491 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,493 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,495 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,497 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,499 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,501 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,503 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,505 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,507 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,509 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,511 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,514 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,516 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,518 copying build/lib/lm_eval/tasks/egymmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,519 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,521 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,523 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,524 copying build/lib/lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,526 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,528 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,529 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,531 copying build/lib/lm_eval/tasks/egymmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,533 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,535 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,537 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,538 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,540 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,542 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,544 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,545 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,547 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,549 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,550 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2025-11-27T00:43:47,553 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox 2025-11-27T00:43:47,555 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,556 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,558 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,559 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,561 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,563 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,564 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,566 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,568 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,570 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,571 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,573 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,575 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,576 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,578 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,580 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,581 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,583 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,585 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,587 copying build/lib/lm_eval/tasks/mmlu_prox/hu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,589 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,590 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,592 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,594 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,595 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,597 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,599 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,600 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,602 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,604 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,605 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,608 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,609 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,611 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2025-11-27T00:43:47,613 copying build/lib/lm_eval/tasks/mmlu_prox/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2025-11-27T00:43:47,616 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,617 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,619 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,621 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,623 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,625 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,627 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,629 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,631 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,632 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,634 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,636 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,638 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,639 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,641 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,642 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,644 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,646 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,647 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,649 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,651 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,652 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,654 copying build/lib/lm_eval/tasks/mmlu_prox/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,656 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,658 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,659 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,661 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,663 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,665 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,666 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,668 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,670 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,672 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,673 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2025-11-27T00:43:47,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,677 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,679 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,681 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,683 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,685 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,687 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,688 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,690 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,692 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,694 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,695 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,697 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,699 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,700 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,702 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,704 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,705 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,707 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,709 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,711 copying build/lib/lm_eval/tasks/mmlu_prox/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,712 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,714 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,716 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,718 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,720 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,722 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,723 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,725 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,727 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,729 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,730 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,732 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,734 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2025-11-27T00:43:47,737 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,738 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,740 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,742 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,743 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,745 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,747 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,749 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,750 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,752 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,754 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,755 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,757 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,759 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,761 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,763 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,765 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,766 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,768 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,770 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,772 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,773 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,775 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,777 copying build/lib/lm_eval/tasks/mmlu_prox/mr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,779 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,780 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,782 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,784 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,785 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,787 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,789 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,791 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,792 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,794 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2025-11-27T00:43:47,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,798 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,800 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,802 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,803 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,805 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,807 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,809 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,810 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,812 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,814 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,816 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,818 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,819 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,821 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,823 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,824 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,826 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,828 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,830 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,832 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,833 copying build/lib/lm_eval/tasks/mmlu_prox/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,835 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,837 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,839 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,841 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,842 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,844 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,846 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,847 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,849 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,851 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,853 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,854 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2025-11-27T00:43:47,857 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,858 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,860 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,862 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,864 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,865 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,867 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,869 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,870 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,872 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,874 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,875 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,877 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,879 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,880 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,882 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,884 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,886 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,887 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,889 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,891 copying build/lib/lm_eval/tasks/mmlu_prox/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,893 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,895 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,896 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,898 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,900 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,902 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,904 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,905 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,907 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,909 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,910 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,912 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,914 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2025-11-27T00:43:47,917 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,918 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,920 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,921 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,923 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,925 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,927 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,929 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,930 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,932 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,934 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,936 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,938 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,940 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,942 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,944 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,946 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,947 copying build/lib/lm_eval/tasks/mmlu_prox/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,950 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,951 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,953 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,955 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,957 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,959 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,961 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,962 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,964 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,966 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,968 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,969 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,971 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,973 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,975 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,976 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2025-11-27T00:43:47,979 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2025-11-27T00:43:47,982 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,983 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,985 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,987 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,989 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,991 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,993 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,994 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,996 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:47,998 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,000 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,002 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,004 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,005 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,007 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,009 copying build/lib/lm_eval/tasks/mmlu_prox/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,011 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,013 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,015 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,016 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,018 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,020 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,021 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,023 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,025 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,027 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,029 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,031 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,032 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,034 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,036 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,038 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,039 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,041 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2025-11-27T00:43:48,044 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,045 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,047 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,049 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,050 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,052 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,054 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,056 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,057 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,059 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,061 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,063 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,064 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,066 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,068 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,070 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,071 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,073 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,075 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,077 copying build/lib/lm_eval/tasks/mmlu_prox/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,079 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,080 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,082 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,084 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,086 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,088 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,089 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,091 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,093 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,095 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,097 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,098 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,100 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,102 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2025-11-27T00:43:48,104 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,105 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,107 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,109 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,111 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,113 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,115 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,117 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,119 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,120 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,122 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,124 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,126 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,128 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,129 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,131 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,133 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,135 copying build/lib/lm_eval/tasks/mmlu_prox/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,137 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,139 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,141 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,143 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,145 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,147 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,148 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,150 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,152 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,154 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,156 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,158 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,159 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,161 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,163 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,165 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2025-11-27T00:43:48,167 copying build/lib/lm_eval/tasks/mmlu_prox/lang_libs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2025-11-27T00:43:48,170 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,171 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,173 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,175 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,177 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,178 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,180 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,182 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,184 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,186 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,188 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,190 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,192 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,193 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,195 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,197 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,199 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,200 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,202 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,204 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,205 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,207 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,209 copying build/lib/lm_eval/tasks/mmlu_prox/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,211 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,213 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,214 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,216 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,219 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,221 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,223 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,226 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,228 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,230 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,233 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2025-11-27T00:43:48,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,237 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,240 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,243 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,245 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,247 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,249 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,252 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,254 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,256 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,258 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,261 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,263 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,265 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,267 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,270 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,272 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,274 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,277 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,279 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,281 copying build/lib/lm_eval/tasks/mmlu_prox/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,284 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,286 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,288 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,291 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,293 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,295 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,298 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,300 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,302 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,304 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,307 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,309 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,311 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2025-11-27T00:43:48,315 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,316 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,319 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,321 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,323 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,325 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,326 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,328 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,330 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,332 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,334 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,335 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,337 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,339 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,341 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,342 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,344 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,346 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,348 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,350 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,352 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,353 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,355 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,357 copying build/lib/lm_eval/tasks/mmlu_prox/af/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,358 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,360 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,362 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,364 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,366 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,367 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,369 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,371 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,373 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,375 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2025-11-27T00:43:48,377 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,378 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,380 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,382 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,384 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,386 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,387 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,389 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,391 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,393 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,395 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,397 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,399 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,400 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,402 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,404 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,406 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,408 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,410 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,412 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,414 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,415 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,417 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,419 copying build/lib/lm_eval/tasks/mmlu_prox/th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,421 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,423 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,425 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,427 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,429 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,431 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,433 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,435 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,437 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,439 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2025-11-27T00:43:48,442 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,443 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,445 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,447 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,449 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,451 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,453 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,455 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,457 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,458 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,460 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,462 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,464 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,466 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,467 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,469 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,471 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,473 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,475 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,477 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,478 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,480 copying build/lib/lm_eval/tasks/mmlu_prox/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,482 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,484 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,486 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,488 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,490 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,491 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,493 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,495 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,497 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,499 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,501 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,503 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2025-11-27T00:43:48,504 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2025-11-27T00:43:48,507 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,509 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,511 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,512 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,514 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,516 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,518 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,520 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,522 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,523 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,525 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,527 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,529 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,531 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,533 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,534 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,536 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,538 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,540 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,542 copying build/lib/lm_eval/tasks/mmlu_prox/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,544 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,546 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,547 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,549 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,551 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,552 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,554 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,556 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,558 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,559 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,561 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,563 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,565 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,567 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2025-11-27T00:43:48,570 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,571 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,573 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,575 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,577 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,579 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,581 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,582 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,584 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,586 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,588 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,590 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,592 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,594 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,596 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,597 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,599 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,601 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,603 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,605 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,607 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,608 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,610 copying build/lib/lm_eval/tasks/mmlu_prox/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,612 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,614 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,616 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,618 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,619 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,621 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,623 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,625 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,627 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,629 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,631 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2025-11-27T00:43:48,634 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,635 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,637 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,639 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,640 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,642 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,644 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,646 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,647 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,649 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,651 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,653 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,655 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,656 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,658 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,660 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,662 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,664 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,666 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,668 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,670 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,672 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,674 copying build/lib/lm_eval/tasks/mmlu_prox/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,676 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,677 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,679 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,681 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,683 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,685 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,687 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,688 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,690 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,692 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,694 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2025-11-27T00:43:48,697 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,698 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,700 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,702 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,704 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,705 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,707 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,709 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,711 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,713 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,715 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,717 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,719 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,721 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,723 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,724 copying build/lib/lm_eval/tasks/mmlu_prox/ur/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,726 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,732 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,734 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,736 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,738 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,740 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,742 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,743 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,745 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,747 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,749 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,751 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,753 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,755 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,756 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,758 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,760 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,762 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2025-11-27T00:43:48,765 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,766 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,768 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,770 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,772 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,773 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,775 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,777 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,779 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,781 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,783 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,785 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,787 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,788 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,790 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,792 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,794 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,796 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,798 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,800 copying build/lib/lm_eval/tasks/mmlu_prox/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,802 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,803 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,805 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,807 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,809 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,811 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,813 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,814 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,816 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,818 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,820 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,822 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,824 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,826 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2025-11-27T00:43:48,829 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,830 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,832 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,834 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,836 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,837 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,839 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,841 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,843 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,845 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,846 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,848 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,850 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,852 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,854 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,855 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,857 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,859 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,861 copying build/lib/lm_eval/tasks/mmlu_prox/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,863 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,865 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,867 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,868 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,870 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,872 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,874 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,876 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,878 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,880 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,882 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,883 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,885 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,887 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,889 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2025-11-27T00:43:48,892 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,893 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,895 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,897 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,899 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,900 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,902 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,904 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,906 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,908 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,910 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,912 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,913 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,915 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,917 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,920 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,922 copying build/lib/lm_eval/tasks/mmlu_prox/zu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,924 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,926 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,928 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,930 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,932 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,934 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,936 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,937 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,939 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,941 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,943 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,944 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,946 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,948 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,950 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,952 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,954 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2025-11-27T00:43:48,957 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,958 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,960 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,962 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,964 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,966 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,968 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,970 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,972 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,974 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,976 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,978 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,980 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,982 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,983 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,985 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,987 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,989 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,991 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,993 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,994 copying build/lib/lm_eval/tasks/mmlu_prox/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,996 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:48,998 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,000 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,002 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,003 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,005 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,007 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,009 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,011 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,013 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,014 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,016 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,018 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2025-11-27T00:43:49,020 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/template 2025-11-27T00:43:49,021 copying build/lib/lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2025-11-27T00:43:49,023 copying build/lib/lm_eval/tasks/mmlu_prox/template/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2025-11-27T00:43:49,026 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,027 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,029 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,030 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,032 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,034 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,035 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,037 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,039 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,040 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,042 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,044 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,045 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,047 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,049 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,050 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,052 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,054 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,055 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,057 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,059 copying build/lib/lm_eval/tasks/mmlu_prox/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,060 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,062 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,064 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,066 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,069 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,070 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,072 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,074 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,075 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,077 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,079 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,080 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,082 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2025-11-27T00:43:49,084 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,085 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,087 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,089 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,090 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,092 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,094 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,096 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,097 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,099 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,101 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,102 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,104 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,106 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,108 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,109 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,111 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,113 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,115 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,116 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,118 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,120 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,122 copying build/lib/lm_eval/tasks/mmlu_prox/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,124 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,126 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,128 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,130 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,131 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,133 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,135 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,137 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,139 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,141 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,143 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2025-11-27T00:43:49,145 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,147 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,149 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,150 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,152 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,154 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,156 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,158 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,160 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,162 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,163 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,165 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,167 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,169 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,171 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,173 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,174 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,176 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,178 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,180 copying build/lib/lm_eval/tasks/mmlu_prox/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,182 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,184 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,186 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,188 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,190 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,192 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,194 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,196 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,198 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,200 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,201 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,203 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,205 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,207 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2025-11-27T00:43:49,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,211 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,213 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,215 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,217 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,219 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,221 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,223 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,224 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,226 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,228 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,230 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,232 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,234 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,236 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,238 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,240 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,242 copying build/lib/lm_eval/tasks/mmlu_prox/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,244 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,246 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,247 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,249 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,251 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,253 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,255 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,257 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,259 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,261 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,262 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,264 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,266 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,267 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,269 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,271 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2025-11-27T00:43:49,273 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,274 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,276 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,278 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,280 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,281 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,283 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,285 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,287 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,289 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,290 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,292 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,294 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,296 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,298 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,300 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,301 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,303 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,305 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,307 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,309 copying build/lib/lm_eval/tasks/mmlu_prox/wo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,311 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,312 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,314 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,316 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,318 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,319 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,321 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,323 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,325 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,327 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,329 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,330 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,332 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2025-11-27T00:43:49,335 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,336 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,338 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,340 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,342 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,344 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,345 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,347 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,349 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,351 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,353 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,355 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,356 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,358 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,360 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,362 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,363 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,365 copying build/lib/lm_eval/tasks/mmlu_prox/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,367 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,369 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,371 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,372 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,374 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,376 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,378 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,380 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,382 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,383 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,385 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,387 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,389 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,391 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,393 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,395 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2025-11-27T00:43:49,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,400 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,402 copying build/lib/lm_eval/tasks/lm_syneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,405 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,407 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,408 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,410 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,412 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,414 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,416 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,417 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,419 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,421 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,423 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,425 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,427 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,428 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,430 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,432 copying build/lib/lm_eval/tasks/lm_syneval/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,434 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,436 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,438 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,440 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,442 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,444 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,445 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,447 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,449 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,451 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,453 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,454 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,456 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,458 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,460 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,462 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,463 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,465 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,467 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,469 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,471 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,473 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,474 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,476 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,478 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,480 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,482 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,484 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,485 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,487 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,489 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,491 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,493 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,495 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,497 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,499 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,500 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,502 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,504 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,506 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,508 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,510 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,512 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,514 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,515 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,517 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,519 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,521 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,523 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,525 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,527 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,529 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,530 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,532 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,534 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,536 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,538 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2025-11-27T00:43:49,541 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals 2025-11-27T00:43:49,545 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,546 copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,548 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,550 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,552 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,554 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,556 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,558 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,559 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,561 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,563 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,565 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,567 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,569 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,571 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,573 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,574 copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,576 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,578 copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,580 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,582 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,584 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,585 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,587 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,589 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,591 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,593 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,595 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,597 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,598 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,600 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,602 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,604 copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,606 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,608 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,610 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,612 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,614 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,615 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,617 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,619 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,621 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,623 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,625 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,626 copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,628 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,630 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,632 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,634 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,636 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,638 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,639 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,641 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,643 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,645 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,647 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,648 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,650 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,652 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,654 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,656 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,658 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,659 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,661 copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,663 copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,665 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,667 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,669 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,670 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,672 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,674 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,676 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,678 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,679 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,681 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,683 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,685 copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,686 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,688 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,690 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,692 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,694 copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,696 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,697 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,699 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,701 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,703 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,705 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,706 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,709 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,711 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,712 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,714 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,716 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,718 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,720 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,722 copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,723 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,725 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,727 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,729 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,731 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,733 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,735 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,737 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,739 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,741 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,743 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,744 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,746 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,748 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,750 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,752 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,754 copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,756 copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,757 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,759 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,761 copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,763 copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,765 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,767 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,769 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,771 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,773 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,774 copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,776 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,778 copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,780 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,782 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,784 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,786 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,788 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,790 copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,791 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,793 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,795 copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,797 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,799 copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2025-11-27T00:43:49,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated 2025-11-27T00:43:49,802 copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated 2025-11-27T00:43:49,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:49,806 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:49,808 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:49,810 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2025-11-27T00:43:49,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,814 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,816 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,818 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,820 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,821 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,823 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,825 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,827 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,829 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,831 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,832 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,834 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,836 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,838 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,840 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,842 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,844 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,845 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,847 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,849 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,851 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,853 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,854 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,856 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,858 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,860 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,862 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,864 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,865 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,867 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,869 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,871 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,872 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,874 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,876 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,878 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,880 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,882 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,883 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,885 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,887 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,889 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,891 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,892 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,894 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,896 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,898 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,900 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,901 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,903 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,905 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2025-11-27T00:43:49,908 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ruler 2025-11-27T00:43:49,909 copying build/lib/lm_eval/tasks/ruler/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,911 copying build/lib/lm_eval/tasks/ruler/niah_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,913 copying build/lib/lm_eval/tasks/ruler/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,915 copying build/lib/lm_eval/tasks/ruler/essays.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,917 copying build/lib/lm_eval/tasks/ruler/niah_single_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,919 copying build/lib/lm_eval/tasks/ruler/fwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,921 copying build/lib/lm_eval/tasks/ruler/cwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,923 copying build/lib/lm_eval/tasks/ruler/niah_single_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,925 copying build/lib/lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,926 copying build/lib/lm_eval/tasks/ruler/cwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,929 copying build/lib/lm_eval/tasks/ruler/ruler.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,930 copying build/lib/lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,932 copying build/lib/lm_eval/tasks/ruler/qa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,935 copying build/lib/lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,936 copying build/lib/lm_eval/tasks/ruler/qa_squad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,939 copying build/lib/lm_eval/tasks/ruler/niah_multiquery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,940 copying build/lib/lm_eval/tasks/ruler/vt_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,943 copying build/lib/lm_eval/tasks/ruler/fwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,945 copying build/lib/lm_eval/tasks/ruler/vt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,947 copying build/lib/lm_eval/tasks/ruler/qa_hotpot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,949 copying build/lib/lm_eval/tasks/ruler/niah_multivalue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,950 copying build/lib/lm_eval/tasks/ruler/niah_single_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,952 copying build/lib/lm_eval/tasks/ruler/prepare_niah.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2025-11-27T00:43:49,955 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete 2025-11-27T00:43:49,957 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:49,958 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:49,960 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:49,962 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2025-11-27T00:43:49,963 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2025-11-27T00:43:49,966 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2025-11-27T00:43:49,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:49,970 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:49,972 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:49,974 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2025-11-27T00:43:49,976 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:49,977 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:49,979 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:49,981 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2025-11-27T00:43:49,984 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:49,985 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:49,987 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:49,989 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2025-11-27T00:43:49,991 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:49,992 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:49,994 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:49,996 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2025-11-27T00:43:49,998 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:49,999 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:50,001 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:50,003 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2025-11-27T00:43:50,006 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,007 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,009 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,011 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,013 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,015 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,017 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,019 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,021 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,023 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,024 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,026 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2025-11-27T00:43:50,029 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:50,030 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:50,032 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:50,034 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2025-11-27T00:43:50,036 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:50,037 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:50,039 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:50,041 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2025-11-27T00:43:50,043 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:50,044 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:50,046 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:50,048 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2025-11-27T00:43:50,052 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,053 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,055 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,057 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,058 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,060 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,062 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,064 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,066 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,068 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,070 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,072 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,074 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,075 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,077 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,079 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,081 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,083 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,085 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,087 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,089 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,091 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,093 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,095 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,096 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,098 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,100 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,102 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,104 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,106 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,108 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,110 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,112 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,114 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,116 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,117 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,119 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,121 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,123 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,125 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,127 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,129 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,131 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,133 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,135 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,136 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,138 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,141 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,142 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,145 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,146 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,148 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,150 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,152 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,154 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,156 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,157 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,159 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,161 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,163 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,165 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2025-11-27T00:43:50,168 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:50,169 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:50,171 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:50,173 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2025-11-27T00:43:50,177 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,178 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,180 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,182 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,184 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,186 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,188 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,190 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,192 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,194 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,196 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,198 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,200 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,201 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,204 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,205 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,207 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,209 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,211 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,213 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,215 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,217 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,218 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,220 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,222 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,224 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,226 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,228 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,230 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,232 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,234 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,236 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,238 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,240 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,242 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,243 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,245 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,247 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,249 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,251 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,253 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,255 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,257 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,259 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,261 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,263 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,265 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,267 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,269 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,271 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,272 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,274 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,276 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,278 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,280 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,282 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,284 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,285 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,287 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,289 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2025-11-27T00:43:50,292 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:50,293 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:50,295 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:50,297 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2025-11-27T00:43:50,299 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:50,300 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:50,302 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:50,304 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2025-11-27T00:43:50,306 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco 2025-11-27T00:43:50,308 copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2025-11-27T00:43:50,310 copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2025-11-27T00:43:50,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:50,313 copying build/lib/lm_eval/tasks/cnn_dailymail/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:50,315 copying build/lib/lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:50,317 copying build/lib/lm_eval/tasks/cnn_dailymail/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2025-11-27T00:43:50,320 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogender 2025-11-27T00:43:50,321 copying build/lib/lm_eval/tasks/winogender/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,323 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,325 copying build/lib/lm_eval/tasks/winogender/winogender_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,327 copying build/lib/lm_eval/tasks/winogender/winogender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,329 copying build/lib/lm_eval/tasks/winogender/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,331 copying build/lib/lm_eval/tasks/winogender/winogender_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,333 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,334 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,336 copying build/lib/lm_eval/tasks/winogender/winogender_neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2025-11-27T00:43:50,339 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/olaph 2025-11-27T00:43:50,340 copying build/lib/lm_eval/tasks/olaph/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2025-11-27T00:43:50,342 copying build/lib/lm_eval/tasks/olaph/olaph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2025-11-27T00:43:50,344 copying build/lib/lm_eval/tasks/olaph/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2025-11-27T00:43:50,346 copying build/lib/lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2025-11-27T00:43:50,347 copying build/lib/lm_eval/tasks/olaph/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2025-11-27T00:43:50,350 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score 2025-11-27T00:43:50,352 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,353 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,355 copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,357 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,359 copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,362 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2025-11-27T00:43:50,364 copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,366 copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,368 copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,370 copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,373 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,374 copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,376 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,378 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,381 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,382 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,384 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,386 copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,388 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,390 copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,392 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,394 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,395 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,397 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,399 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,401 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,403 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,404 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,406 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,408 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,410 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,412 copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,414 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,416 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,417 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,419 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,421 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,423 copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2025-11-27T00:43:50,426 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math 2025-11-27T00:43:50,427 copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,429 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,431 copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,434 copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,436 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,438 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,440 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,441 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,443 copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,445 copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,447 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,449 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,451 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,453 copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,455 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,456 copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,458 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,460 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,462 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,464 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,466 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2025-11-27T00:43:50,468 copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,470 copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2025-11-27T00:43:50,473 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze 2025-11-27T00:43:50,474 copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2025-11-27T00:43:50,476 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2025-11-27T00:43:50,478 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2025-11-27T00:43:50,481 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus 2025-11-27T00:43:50,482 copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2025-11-27T00:43:50,486 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,487 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,489 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,491 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,492 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,494 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,496 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,498 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,500 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,502 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,504 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,506 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,508 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,510 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,512 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,514 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,516 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,519 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,521 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,523 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,525 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,526 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,528 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,531 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,532 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,534 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,536 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,538 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,540 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,541 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,543 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,545 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,547 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,549 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,551 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,552 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,554 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,556 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,558 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,560 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,562 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,564 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,565 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,567 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,569 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,571 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,573 copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,575 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,576 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,578 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,580 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,582 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,584 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,586 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,588 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,589 copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,592 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,594 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,596 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,597 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,599 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,601 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,603 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,605 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,606 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,608 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,610 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,612 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,614 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,616 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,618 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,619 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,621 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,623 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,625 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,627 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2025-11-27T00:43:50,629 copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2025-11-27T00:43:50,631 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval 2025-11-27T00:43:50,632 copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,634 copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,637 copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,640 copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,642 copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,644 copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2025-11-27T00:43:50,647 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:50,648 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:50,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,652 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,654 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,656 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,658 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,660 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,662 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,663 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,665 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,667 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,669 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,671 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,673 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,674 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,676 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,678 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,680 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,682 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,683 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,685 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,687 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,689 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,691 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,693 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,695 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,697 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,699 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,701 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,703 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,704 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,706 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,708 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,710 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,712 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,714 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,716 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,718 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,720 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,722 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,723 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,725 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,727 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,729 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,731 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,733 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,735 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,737 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,739 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,741 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,743 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,745 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,747 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,749 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,750 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,752 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,754 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,756 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,758 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,760 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,761 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2025-11-27T00:43:50,763 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2025-11-27T00:43:50,766 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc 2025-11-27T00:43:50,767 copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2025-11-27T00:43:50,769 copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2025-11-27T00:43:50,771 copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2025-11-27T00:43:50,773 copying build/lib/lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2025-11-27T00:43:50,775 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion 2025-11-27T00:43:50,776 copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2025-11-27T00:43:50,779 copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2025-11-27T00:43:50,781 copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2025-11-27T00:43:50,783 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa 2025-11-27T00:43:50,785 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:50,786 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:50,788 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2025-11-27T00:43:50,791 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:50,792 copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:50,794 copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2025-11-27T00:43:50,796 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre 2025-11-27T00:43:50,797 copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2025-11-27T00:43:50,799 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2025-11-27T00:43:50,801 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2025-11-27T00:43:50,803 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2025-11-27T00:43:50,805 copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2025-11-27T00:43:50,807 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2025-11-27T00:43:50,810 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue 2025-11-27T00:43:50,811 copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,813 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,815 copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,817 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,819 copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,821 copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,823 copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,825 copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,827 copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,829 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,831 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,833 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,836 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,838 copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,840 copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,843 copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,845 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,847 copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,849 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2025-11-27T00:43:50,851 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa 2025-11-27T00:43:50,853 copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2025-11-27T00:43:50,855 copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2025-11-27T00:43:50,857 copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2025-11-27T00:43:50,860 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turblimp 2025-11-27T00:43:50,861 copying build/lib/lm_eval/tasks/turblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,863 copying build/lib/lm_eval/tasks/turblimp/binding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,865 copying build/lib/lm_eval/tasks/turblimp/irregular_forms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,867 copying build/lib/lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,869 copying build/lib/lm_eval/tasks/turblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,870 copying build/lib/lm_eval/tasks/turblimp/ellipsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,872 copying build/lib/lm_eval/tasks/turblimp/quantifiers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,874 copying build/lib/lm_eval/tasks/turblimp/subject_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,876 copying build/lib/lm_eval/tasks/turblimp/nominalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,878 copying build/lib/lm_eval/tasks/turblimp/relative_clauses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,880 copying build/lib/lm_eval/tasks/turblimp/passives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,881 copying build/lib/lm_eval/tasks/turblimp/scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,883 copying build/lib/lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,885 copying build/lib/lm_eval/tasks/turblimp/determiners.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,887 copying build/lib/lm_eval/tasks/turblimp/npi_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,889 copying build/lib/lm_eval/tasks/turblimp/turblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,891 copying build/lib/lm_eval/tasks/turblimp/island_effects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,892 copying build/lib/lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,894 copying build/lib/lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2025-11-27T00:43:50,897 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext 2025-11-27T00:43:50,898 copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2025-11-27T00:43:50,900 copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2025-11-27T00:43:50,902 copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2025-11-27T00:43:50,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae 2025-11-27T00:43:50,905 copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,907 copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,910 copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,911 copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,913 copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,915 copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,917 copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,918 copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2025-11-27T00:43:50,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue 2025-11-27T00:43:50,922 copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,924 copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,926 copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,928 copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,930 copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,931 copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,933 copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,935 copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2025-11-27T00:43:50,938 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa 2025-11-27T00:43:50,939 copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2025-11-27T00:43:50,941 copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2025-11-27T00:43:50,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench 2025-11-27T00:43:50,945 copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,947 copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,949 copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,951 copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,953 copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,955 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,957 copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,959 copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,961 copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:50,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,965 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,967 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,969 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,971 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,973 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,975 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,976 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,978 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,980 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,982 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,984 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,986 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,988 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,990 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,991 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,993 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,995 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,997 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:50,999 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2025-11-27T00:43:51,001 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,003 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,005 copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,007 copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,009 copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,010 copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2025-11-27T00:43:51,013 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click 2025-11-27T00:43:51,014 copying build/lib/lm_eval/tasks/click/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2025-11-27T00:43:51,017 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,018 copying build/lib/lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,020 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,022 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,024 copying build/lib/lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,025 copying build/lib/lm_eval/tasks/click/click_lang/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,027 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2025-11-27T00:43:51,029 copying build/lib/lm_eval/tasks/click/click.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2025-11-27T00:43:51,032 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,033 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,036 copying build/lib/lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,037 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,039 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,041 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,043 copying build/lib/lm_eval/tasks/click/click_cul/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,045 copying build/lib/lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,047 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,049 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,051 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,053 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2025-11-27T00:43:51,055 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq 2025-11-27T00:43:51,056 copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2025-11-27T00:43:51,058 copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2025-11-27T00:43:51,061 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen 2025-11-27T00:43:51,062 copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2025-11-27T00:43:51,064 copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2025-11-27T00:43:51,066 copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2025-11-27T00:43:51,069 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2 2025-11-27T00:43:51,070 copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2025-11-27T00:43:51,072 copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2025-11-27T00:43:51,074 copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2025-11-27T00:43:51,076 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:51,078 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:51,080 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:51,082 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:51,083 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2025-11-27T00:43:51,087 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijammlu 2025-11-27T00:43:51,088 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,090 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,092 copying build/lib/lm_eval/tasks/darijammlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,094 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,096 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,098 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,100 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,102 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,104 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,106 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,108 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,110 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,112 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,114 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,116 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,118 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,120 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,122 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,124 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,125 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,127 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,129 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,131 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,133 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,134 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,136 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,138 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,140 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,142 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,144 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,145 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,147 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,149 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,151 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,153 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,155 copying build/lib/lm_eval/tasks/darijammlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,157 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,158 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,160 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,162 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,164 copying build/lib/lm_eval/tasks/darijammlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,166 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,168 copying build/lib/lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,170 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,172 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,174 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,175 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,177 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,179 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,181 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,183 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2025-11-27T00:43:51,185 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,186 copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,188 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,190 copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,192 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,194 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,196 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,198 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,200 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,202 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,204 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,206 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,208 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,210 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2025-11-27T00:43:51,212 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm 2025-11-27T00:43:51,213 copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2025-11-27T00:43:51,215 copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2025-11-27T00:43:51,218 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,219 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,221 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,223 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,225 copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,226 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,228 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,230 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,231 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,233 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,235 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,237 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,239 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2025-11-27T00:43:51,241 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,242 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,244 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,246 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,248 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,250 copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,252 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,254 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,255 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,257 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,259 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,261 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,263 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2025-11-27T00:43:51,265 copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2025-11-27T00:43:51,268 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,269 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,271 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,273 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,275 copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,276 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,278 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,280 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,282 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,284 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,286 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,288 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,290 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2025-11-27T00:43:51,292 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light 2025-11-27T00:43:51,293 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2025-11-27T00:43:51,295 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2025-11-27T00:43:51,299 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,300 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,302 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,304 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,306 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,308 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,310 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,312 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,314 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,316 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,318 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,320 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,322 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,324 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,326 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,328 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,330 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,331 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,333 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,335 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,337 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,339 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,341 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,343 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,345 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,347 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,348 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,350 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,352 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,354 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,356 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,357 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,360 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,361 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,363 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,365 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,367 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,369 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,371 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,372 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,374 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,376 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,378 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,380 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,382 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,383 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,385 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,387 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,389 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,391 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,393 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,395 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,396 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,398 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,400 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,402 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,404 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,406 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,408 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,410 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,411 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2025-11-27T00:43:51,414 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:51,415 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:51,417 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:51,418 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2025-11-27T00:43:51,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:51,422 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:51,424 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:51,426 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2025-11-27T00:43:51,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:51,429 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:51,431 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:51,433 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2025-11-27T00:43:51,435 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:51,436 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:51,438 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:51,440 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2025-11-27T00:43:51,443 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:51,443 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:51,445 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:51,447 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2025-11-27T00:43:51,450 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:51,451 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:51,452 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:51,454 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2025-11-27T00:43:51,457 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:51,458 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:51,460 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:51,462 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2025-11-27T00:43:51,464 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:51,465 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:51,467 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:51,469 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2025-11-27T00:43:51,471 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:51,472 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:51,474 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:51,476 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2025-11-27T00:43:51,479 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,480 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,482 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,484 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,486 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,488 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,490 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,491 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,493 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,495 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,497 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,499 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,501 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,503 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,504 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,506 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,508 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,510 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,512 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,513 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,515 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,517 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,519 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,521 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,523 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,525 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,527 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,528 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,530 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,532 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,534 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,536 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,538 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,540 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,542 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,544 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,545 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,547 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,549 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,551 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,553 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,555 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,556 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,558 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,560 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,562 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,564 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,566 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,568 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,569 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,571 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,573 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,575 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,577 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,579 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,581 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,583 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,585 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,587 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,589 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2025-11-27T00:43:51,591 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:51,592 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:51,594 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:51,596 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2025-11-27T00:43:51,598 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:51,599 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:51,601 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:51,603 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2025-11-27T00:43:51,606 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:51,607 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:51,609 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:51,611 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2025-11-27T00:43:51,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,614 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,616 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,618 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,620 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,622 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,624 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,626 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,628 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,630 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,632 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,634 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2025-11-27T00:43:51,636 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv 2025-11-27T00:43:51,637 copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2025-11-27T00:43:51,639 copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2025-11-27T00:43:51,641 copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2025-11-27T00:43:51,644 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa 2025-11-27T00:43:51,645 copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2025-11-27T00:43:51,647 copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2025-11-27T00:43:51,649 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic 2025-11-27T00:43:51,650 copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,652 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,654 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,656 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,658 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,660 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,662 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,664 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,666 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,668 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,670 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2025-11-27T00:43:51,672 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id 2025-11-27T00:43:51,673 copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2025-11-27T00:43:51,675 copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2025-11-27T00:43:51,677 copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2025-11-27T00:43:51,679 copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2025-11-27T00:43:51,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,683 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,685 copying build/lib/lm_eval/tasks/arab_culture_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,686 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,688 copying build/lib/lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,690 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,692 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,694 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,696 copying build/lib/lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,697 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,699 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,701 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,703 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,705 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,707 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,709 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,710 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,712 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,715 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,717 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,719 copying build/lib/lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,721 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,723 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,724 copying build/lib/lm_eval/tasks/arab_culture_completion/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2025-11-27T00:43:51,728 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli 2025-11-27T00:43:51,729 copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,731 copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,732 copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,734 copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,736 copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,738 copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,740 copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,742 copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,744 copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,745 copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,747 copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,749 copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,751 copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,753 copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,755 copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,757 copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,759 copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,761 copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,763 copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2025-11-27T00:43:51,766 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval 2025-11-27T00:43:51,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa 2025-11-27T00:43:51,769 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2025-11-27T00:43:51,771 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,772 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,774 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,776 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,778 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,780 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,782 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2025-11-27T00:43:51,784 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2025-11-27T00:43:51,786 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,787 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,789 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,791 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,793 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,795 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,797 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2025-11-27T00:43:51,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:43:51,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,802 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,804 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,806 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,808 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,810 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2025-11-27T00:43:51,812 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:43:51,815 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,816 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,818 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,820 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,822 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,824 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2025-11-27T00:43:51,826 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2025-11-27T00:43:51,827 copying build/lib/lm_eval/tasks/noreval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2025-11-27T00:43:51,830 copying build/lib/lm_eval/tasks/noreval/noreval.jpg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2025-11-27T00:43:51,842 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsummarize-instruct 2025-11-27T00:43:51,843 copying build/lib/lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsummarize-instruct 2025-11-27T00:43:51,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,847 copying build/lib/lm_eval/tasks/noreval/ask_gec/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,849 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,851 copying build/lib/lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,853 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,855 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,857 copying build/lib/lm_eval/tasks/noreval/ask_gec/errant.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,859 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,860 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2025-11-27T00:43:51,863 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa 2025-11-27T00:43:51,864 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,866 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,868 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,870 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,872 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,874 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,876 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2025-11-27T00:43:51,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,880 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,882 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,883 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,885 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,887 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,889 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2025-11-27T00:43:51,891 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa 2025-11-27T00:43:51,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba 2025-11-27T00:43:51,895 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:51,896 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:51,898 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:51,900 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:51,902 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2025-11-27T00:43:51,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:51,905 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:51,907 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:51,909 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:51,911 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2025-11-27T00:43:51,913 copying build/lib/lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba 2025-11-27T00:43:51,915 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:51,916 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:51,918 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:51,920 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:51,922 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2025-11-27T00:43:51,925 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:51,926 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:51,927 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:51,929 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:51,931 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2025-11-27T00:43:51,933 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:43:51,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,936 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,938 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,940 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,942 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,944 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2025-11-27T00:43:51,946 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:43:51,948 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2025-11-27T00:43:51,950 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,951 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,953 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,955 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,957 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,959 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2025-11-27T00:43:51,961 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom 2025-11-27T00:43:51,963 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,964 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,967 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,968 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,970 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,972 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2025-11-27T00:43:51,974 copying build/lib/lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2025-11-27T00:43:51,976 copying build/lib/lm_eval/tasks/noreval/noridiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2025-11-27T00:43:51,979 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,980 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,982 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,984 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,986 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,988 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2025-11-27T00:43:51,990 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa 2025-11-27T00:43:51,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:51,993 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:51,995 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:51,997 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:51,999 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:52,001 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2025-11-27T00:43:52,003 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa 2025-11-27T00:43:52,006 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,007 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,009 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,011 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,013 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,015 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2025-11-27T00:43:52,018 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ncb 2025-11-27T00:43:52,019 copying build/lib/lm_eval/tasks/noreval/ncb/ncb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ncb 2025-11-27T00:43:52,021 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec 2025-11-27T00:43:52,023 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,024 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,026 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,028 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,030 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,032 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2025-11-27T00:43:52,033 copying build/lib/lm_eval/tasks/noreval/norec/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2025-11-27T00:43:52,035 copying build/lib/lm_eval/tasks/noreval/norec/_norec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2025-11-27T00:43:52,038 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,039 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,041 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,043 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,045 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,047 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2025-11-27T00:43:52,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm 2025-11-27T00:43:52,051 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,052 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,054 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,056 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,058 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,060 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,062 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2025-11-27T00:43:52,064 copying build/lib/lm_eval/tasks/noreval/norsumm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2025-11-27T00:43:52,066 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,068 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,070 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,071 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,073 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,075 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,077 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2025-11-27T00:43:52,079 copying build/lib/lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2025-11-27T00:43:52,082 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,083 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,085 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,087 copying build/lib/lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,088 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,090 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,092 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2025-11-27T00:43:52,095 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,096 copying build/lib/lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,098 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,100 copying build/lib/lm_eval/tasks/noreval/norquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,102 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,104 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,106 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,108 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2025-11-27T00:43:52,110 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norrewrite-instruct 2025-11-27T00:43:52,112 copying build/lib/lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norrewrite-instruct 2025-11-27T00:43:52,115 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medtext 2025-11-27T00:43:52,116 copying build/lib/lm_eval/tasks/medtext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2025-11-27T00:43:52,118 copying build/lib/lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2025-11-27T00:43:52,120 copying build/lib/lm_eval/tasks/medtext/medtext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2025-11-27T00:43:52,121 copying build/lib/lm_eval/tasks/medtext/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2025-11-27T00:43:52,123 copying build/lib/lm_eval/tasks/medtext/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2025-11-27T00:43:52,126 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2 2025-11-27T00:43:52,127 copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2025-11-27T00:43:52,129 copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2025-11-27T00:43:52,131 copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2025-11-27T00:43:52,134 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading 2025-11-27T00:43:52,135 copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2025-11-27T00:43:52,137 copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2025-11-27T00:43:52,139 copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2025-11-27T00:43:52,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue 2025-11-27T00:43:52,142 copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue 2025-11-27T00:43:52,145 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:52,146 copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:52,148 copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:52,150 copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:52,152 copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2025-11-27T00:43:52,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb 2025-11-27T00:43:52,155 copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2025-11-27T00:43:52,158 copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2025-11-27T00:43:52,159 copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2025-11-27T00:43:52,162 copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2025-11-27T00:43:52,164 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:52,165 copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:52,167 copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:52,169 copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2025-11-27T00:43:52,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa 2025-11-27T00:43:52,173 copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2025-11-27T00:43:52,175 copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2025-11-27T00:43:52,177 copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2025-11-27T00:43:52,179 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record 2025-11-27T00:43:52,180 copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2025-11-27T00:43:52,182 copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2025-11-27T00:43:52,184 copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2025-11-27T00:43:52,186 copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2025-11-27T00:43:52,188 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic 2025-11-27T00:43:52,189 copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2025-11-27T00:43:52,191 copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2025-11-27T00:43:52,194 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:52,195 copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:52,197 copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:52,199 copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2025-11-27T00:43:52,201 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte 2025-11-27T00:43:52,202 copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2025-11-27T00:43:52,204 copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2025-11-27T00:43:52,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/esbbq 2025-11-27T00:43:52,208 copying build/lib/lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,210 copying build/lib/lm_eval/tasks/esbbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,212 copying build/lib/lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,214 copying build/lib/lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,216 copying build/lib/lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,218 copying build/lib/lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,220 copying build/lib/lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,222 copying build/lib/lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,223 copying build/lib/lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,225 copying build/lib/lm_eval/tasks/esbbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,228 copying build/lib/lm_eval/tasks/esbbq/esbbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,230 copying build/lib/lm_eval/tasks/esbbq/esbbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,232 copying build/lib/lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,233 copying build/lib/lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2025-11-27T00:43:52,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux 2025-11-27T00:43:52,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,240 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,242 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,244 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,246 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,247 copying build/lib/lm_eval/tasks/mmlu-redux/generative/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,249 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,251 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,253 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,255 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,257 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,259 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,261 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,262 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,264 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,266 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,268 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,270 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,272 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,274 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,276 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,278 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,279 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,281 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,283 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,285 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,287 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,289 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,290 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,292 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,294 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,296 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,298 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,300 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,302 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,303 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,305 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,307 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,309 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,311 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,313 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,315 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,317 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,319 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,321 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,322 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,324 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,326 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,328 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,330 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,332 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,334 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,336 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,338 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,339 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,341 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,343 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,345 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,347 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,349 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,351 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2025-11-27T00:43:52,354 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma 2025-11-27T00:43:52,355 copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,357 copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,359 copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,361 copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,364 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,366 copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,368 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,370 copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,371 copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,373 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,375 copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,377 copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,378 copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,380 copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,382 copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,384 copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,386 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,387 copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,389 copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2025-11-27T00:43:52,392 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,393 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,395 copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,398 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,400 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,401 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,403 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,405 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,407 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,409 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,411 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,413 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,414 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,416 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,418 copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,420 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,422 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,423 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,425 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,427 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,429 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,431 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,432 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,434 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,436 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2025-11-27T00:43:52,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench 2025-11-27T00:43:52,440 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,441 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,443 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,446 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,448 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,449 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,451 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,454 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,457 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,459 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,461 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,463 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2025-11-27T00:43:52,465 copying build/lib/lm_eval/tasks/acpbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench 2025-11-27T00:43:52,468 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,469 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,471 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,473 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,475 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,477 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,479 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,481 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,483 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2025-11-27T00:43:52,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,486 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,488 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,490 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,492 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,494 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,496 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,498 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,500 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2025-11-27T00:43:52,503 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,504 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,506 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,508 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,511 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,513 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,516 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,518 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,521 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,523 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,526 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,527 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2025-11-27T00:43:52,530 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu 2025-11-27T00:43:52,532 copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2025-11-27T00:43:52,534 copying build/lib/lm_eval/tasks/afrimmlu/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2025-11-27T00:43:52,536 copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2025-11-27T00:43:52,538 copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2025-11-27T00:43:52,540 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct 2025-11-27T00:43:52,541 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2025-11-27T00:43:52,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,545 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,547 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,549 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,551 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,553 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,555 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,558 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,560 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,562 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,564 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,567 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,569 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,572 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,574 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,576 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,579 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,581 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,583 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,586 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,588 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2025-11-27T00:43:52,591 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,593 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,595 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,598 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,600 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,602 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,604 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,607 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,609 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,611 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,614 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,616 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,619 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,621 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,623 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,625 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,627 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,630 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,632 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,634 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,636 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2025-11-27T00:43:52,640 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,641 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,643 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,646 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,648 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,650 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,653 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,655 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,657 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,659 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,661 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,663 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,665 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,666 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,668 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,670 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,672 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,674 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,676 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,678 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,680 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2025-11-27T00:43:52,683 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,684 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,686 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,688 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,689 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,691 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,693 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,695 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,697 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,699 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,701 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,703 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,704 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,706 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,708 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,710 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,712 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,713 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,715 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,717 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,719 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2025-11-27T00:43:52,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,723 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,724 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,726 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,728 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,730 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,732 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,734 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,736 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,738 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,740 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,741 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,743 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,745 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,747 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,749 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,750 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,752 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,754 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,756 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,758 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2025-11-27T00:43:52,760 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate 2025-11-27T00:43:52,762 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,763 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,765 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,767 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,769 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,771 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,773 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,774 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,776 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,778 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,780 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,782 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,783 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,785 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,787 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,789 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,791 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,793 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,794 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,796 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2025-11-27T00:43:52,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,800 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,803 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,804 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,806 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,808 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,810 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,812 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,814 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,815 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,817 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,819 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,821 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,823 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,825 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,826 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,828 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,830 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,832 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,834 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2025-11-27T00:43:52,835 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2025-11-27T00:43:52,838 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,839 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,841 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,843 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,844 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,846 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,848 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,849 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,851 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,853 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,855 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,856 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,858 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,860 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,862 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,863 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,865 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,867 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,869 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,871 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2025-11-27T00:43:52,873 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,874 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,876 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,878 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,880 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,882 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,884 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,885 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,887 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,889 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,891 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,892 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,894 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,896 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,898 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,900 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,901 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,903 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,905 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,907 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2025-11-27T00:43:52,909 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,910 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,912 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,914 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,916 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,918 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,920 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,922 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,923 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,925 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,927 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,929 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,930 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,932 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,934 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,935 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,937 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,939 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,941 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,942 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2025-11-27T00:43:52,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_prescriptions 2025-11-27T00:43:52,946 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2025-11-27T00:43:52,948 copying build/lib/lm_eval/tasks/med_prescriptions/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2025-11-27T00:43:52,951 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2025-11-27T00:43:52,954 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:52,955 copying build/lib/lm_eval/tasks/icelandic_winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:52,957 copying build/lib/lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:52,959 copying build/lib/lm_eval/tasks/icelandic_winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2025-11-27T00:43:52,961 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,962 copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,964 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,966 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,967 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,969 copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2025-11-27T00:43:52,971 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273 2025-11-27T00:43:52,972 copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2025-11-27T00:43:52,974 copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2025-11-27T00:43:52,976 copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2025-11-27T00:43:52,978 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,979 copying build/lib/lm_eval/tasks/mts_dialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,981 copying build/lib/lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,983 copying build/lib/lm_eval/tasks/mts_dialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,985 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,986 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2025-11-27T00:43:52,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue 2025-11-27T00:43:52,990 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:52,991 copying build/lib/lm_eval/tasks/code_x_glue/code-text/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:52,993 copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:52,995 copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:52,997 copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:52,999 copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,001 copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,003 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,004 copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,006 copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,008 copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,010 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2025-11-27T00:43:53,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice 2025-11-27T00:43:53,014 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,015 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,017 copying build/lib/lm_eval/tasks/aradice/winogrande/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,019 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,021 copying build/lib/lm_eval/tasks/aradice/winogrande/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,023 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,024 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2025-11-27T00:43:53,026 copying build/lib/lm_eval/tasks/aradice/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2025-11-27T00:43:53,028 copying build/lib/lm_eval/tasks/aradice/aradice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2025-11-27T00:43:53,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,031 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,033 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,035 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,037 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,039 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,040 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,042 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,044 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2025-11-27T00:43:53,046 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq 2025-11-27T00:43:53,048 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:43:53,049 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:43:53,051 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:43:53,053 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2025-11-27T00:43:53,055 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:43:53,056 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:43:53,058 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:43:53,060 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2025-11-27T00:43:53,062 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:43:53,063 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:43:53,065 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:43:53,067 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2025-11-27T00:43:53,069 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:43:53,070 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:43:53,072 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:43:53,074 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2025-11-27T00:43:53,076 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,077 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,078 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,080 copying build/lib/lm_eval/tasks/aradice/piqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,082 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,083 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2025-11-27T00:43:53,086 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,087 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,089 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,091 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,092 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,095 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2025-11-27T00:43:53,097 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,098 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,100 copying build/lib/lm_eval/tasks/aradice/openbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,102 copying build/lib/lm_eval/tasks/aradice/openbookqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,103 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,105 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,107 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2025-11-27T00:43:53,109 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU 2025-11-27T00:43:53,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,113 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,115 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,117 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,118 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,120 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,122 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,123 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,125 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,127 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,128 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,130 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,132 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,134 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,136 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,137 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,139 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,141 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,143 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,144 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,146 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,148 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,150 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,152 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,153 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,155 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,157 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,159 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,160 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,162 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,164 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,166 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,167 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,169 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,171 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,173 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,174 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,176 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,178 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,180 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,181 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,183 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,185 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,187 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,188 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2025-11-27T00:43:53,191 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,192 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,194 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,195 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,197 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,199 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,201 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,203 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,204 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,206 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,208 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,210 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,212 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,213 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,215 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,217 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,219 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,220 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,222 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,224 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,225 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,227 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,229 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,231 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,232 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,234 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,236 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,238 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,239 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,241 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,243 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,244 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,246 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,248 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,250 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,251 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,253 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,255 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,257 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,259 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,261 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,262 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,264 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,266 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,267 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2025-11-27T00:43:53,270 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency 2025-11-27T00:43:53,271 copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2025-11-27T00:43:53,273 copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2025-11-27T00:43:53,275 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu 2025-11-27T00:43:53,276 copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu 2025-11-27T00:43:53,279 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,280 copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,282 copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,283 copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,285 copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,287 copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,289 copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,290 copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,292 copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,294 copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,296 copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2025-11-27T00:43:53,298 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,299 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,301 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,304 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,306 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,308 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,310 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,312 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,314 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,316 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,318 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2025-11-27T00:43:53,321 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,322 copying build/lib/lm_eval/tasks/gsm8k_platinum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,324 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,326 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,328 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,329 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,331 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2025-11-27T00:43:53,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aime 2025-11-27T00:43:53,334 copying build/lib/lm_eval/tasks/aime/aime.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2025-11-27T00:43:53,336 copying build/lib/lm_eval/tasks/aime/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2025-11-27T00:43:53,338 copying build/lib/lm_eval/tasks/aime/aime24.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2025-11-27T00:43:53,340 copying build/lib/lm_eval/tasks/aime/aime25.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2025-11-27T00:43:53,342 copying build/lib/lm_eval/tasks/aime/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2025-11-27T00:43:53,345 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls 2025-11-27T00:43:53,346 copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,348 copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,349 copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,351 copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,353 copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,355 copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,356 copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,359 copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,360 copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2025-11-27T00:43:53,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl 2025-11-27T00:43:53,364 copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl 2025-11-27T00:43:53,366 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,367 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,369 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,371 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,373 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,374 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,376 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,378 copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,380 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2025-11-27T00:43:53,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,383 copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,385 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,387 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,389 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,390 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2025-11-27T00:43:53,393 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam 2025-11-27T00:43:53,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,395 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,397 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,399 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,401 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,403 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,404 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,406 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,408 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,409 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,411 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,413 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,414 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,416 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,418 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,420 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2025-11-27T00:43:53,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,423 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,425 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,427 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,429 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,430 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,432 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,434 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,435 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,437 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,439 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,441 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,442 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,444 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,446 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2025-11-27T00:43:53,448 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,449 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,451 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,452 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,454 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,455 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,457 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,459 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,460 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,462 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,464 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,466 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,467 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,469 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,471 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2025-11-27T00:43:53,473 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,474 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,476 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,478 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,479 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,481 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,483 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,484 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,486 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,488 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,490 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,491 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,493 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,495 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,496 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,499 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2025-11-27T00:43:53,501 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper 2025-11-27T00:43:53,502 copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2025-11-27T00:43:53,504 copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2025-11-27T00:43:53,506 copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2025-11-27T00:43:53,507 copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2025-11-27T00:43:53,509 copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2025-11-27T00:43:53,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,513 copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,515 copying build/lib/lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,517 copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,519 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,520 copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,522 copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,524 copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,526 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,527 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,529 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,530 copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,532 copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,534 copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,537 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,539 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,541 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,543 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,544 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,546 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,548 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,550 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,551 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,553 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,555 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,556 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,558 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,560 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,562 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,564 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,566 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,567 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,569 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2025-11-27T00:43:53,571 copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,573 copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,574 copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,576 copying build/lib/lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,579 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:53,580 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:53,581 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:53,583 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2025-11-27T00:43:53,585 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,586 copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,588 copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,590 copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,592 copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,593 copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,595 copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,597 copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,598 copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,600 copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2025-11-27T00:43:53,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard 2025-11-27T00:43:53,604 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:43:53,605 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:43:53,607 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2025-11-27T00:43:53,609 copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2025-11-27T00:43:53,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,613 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,614 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,616 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,618 copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,620 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,621 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2025-11-27T00:43:53,624 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,625 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,627 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,629 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,630 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,632 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,634 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,636 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,637 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,639 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,641 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,643 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,644 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,646 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,648 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,650 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,652 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,654 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,655 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,657 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,659 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,661 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,662 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,664 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,666 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,668 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,670 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2025-11-27T00:43:53,672 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,673 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,676 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,678 copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,680 copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,682 copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,684 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2025-11-27T00:43:53,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,688 copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,690 copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,691 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,693 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,695 copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,697 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2025-11-27T00:43:53,699 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,701 copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,702 copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,704 copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,706 copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,708 copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,709 copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,712 copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,713 copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,715 copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,717 copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2025-11-27T00:43:53,718 copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2025-11-27T00:43:53,721 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr 2025-11-27T00:43:53,722 copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2025-11-27T00:43:53,725 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,726 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,728 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,730 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,731 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,733 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,735 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,737 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,738 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,740 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,742 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,744 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,745 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,747 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,749 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,751 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,753 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,754 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,756 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,758 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,759 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,761 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,763 copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,764 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,766 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,771 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,773 copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,775 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,776 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,778 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,780 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,782 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,784 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,786 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,787 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,789 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,791 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,793 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,795 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,796 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,798 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,800 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,802 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,803 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,805 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,807 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,809 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,811 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,812 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,814 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,816 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,817 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,819 copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,821 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,823 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,825 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,826 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,828 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,830 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,832 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,834 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2025-11-27T00:43:53,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,838 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,840 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,842 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,844 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,845 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,847 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,849 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,851 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,852 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,854 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,856 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,858 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,859 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,861 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,863 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,864 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,866 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,868 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,870 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,871 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,873 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,875 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,876 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,878 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,880 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,882 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,883 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,885 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,887 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,889 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,891 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,892 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,894 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,896 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,898 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,899 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,901 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,903 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,905 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,906 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,908 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,910 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,911 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,913 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,915 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,916 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,918 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,920 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,922 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,923 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,925 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,927 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,929 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,930 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,932 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,934 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,936 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,937 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,939 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,941 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2025-11-27T00:43:53,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,945 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,947 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,949 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,950 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,952 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,954 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,955 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,957 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,959 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,961 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,962 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,964 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,966 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,967 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,969 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,971 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,973 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,974 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,976 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,978 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,980 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,981 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,983 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,985 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,986 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,988 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,990 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,991 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,993 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,995 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,997 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:53,998 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,000 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,002 copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,003 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,005 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,007 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,009 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,011 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,012 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,014 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,016 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,018 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,020 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,021 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,023 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,025 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,026 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,028 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,030 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,031 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,033 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,035 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,037 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,038 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,040 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,042 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,043 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,045 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,047 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2025-11-27T00:43:54,049 copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2025-11-27T00:43:54,052 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu 2025-11-27T00:43:54,052 copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2025-11-27T00:43:54,056 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,057 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,059 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,061 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,063 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,065 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,067 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,069 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,071 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,073 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,075 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,076 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,079 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,080 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,086 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,088 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,090 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,092 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,094 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,096 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,098 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,100 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,102 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,104 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,106 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,108 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,110 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,112 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,114 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,116 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,118 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,120 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,122 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,124 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,125 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,127 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,129 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,131 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,133 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,135 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,137 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,139 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,141 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,143 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,145 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,147 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,149 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,151 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,153 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,155 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,158 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,160 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,162 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,164 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,165 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,167 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,169 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,171 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,173 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,175 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,178 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2025-11-27T00:43:54,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot 2025-11-27T00:43:54,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,184 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,186 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,188 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,189 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,191 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,193 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,195 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,196 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,198 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,200 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,202 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,204 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,205 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,207 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,209 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,210 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,212 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,214 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,215 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,217 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,219 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,220 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,222 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,224 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,226 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,228 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,229 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,231 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,233 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,234 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,236 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,238 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,240 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,241 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,243 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,245 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,246 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,248 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,250 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,251 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,254 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,255 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,257 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,259 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,260 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,262 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,264 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,266 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,267 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,269 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,271 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,273 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,274 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,276 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,278 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,280 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,281 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,283 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,284 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,286 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2025-11-27T00:43:54,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,290 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,292 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,294 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,296 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,297 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,299 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,301 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,303 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,304 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,306 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,308 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,310 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,311 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,313 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,315 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,316 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,318 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,320 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,321 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,323 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,325 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,326 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,328 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,330 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,332 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,333 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,335 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,337 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,339 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,340 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,342 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,344 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,346 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,347 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,349 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,351 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,352 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,354 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,356 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,357 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,359 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,361 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,363 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,364 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,366 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,368 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,370 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,372 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,373 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,375 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,377 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,379 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,380 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,382 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,384 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,385 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,387 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,389 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,391 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2025-11-27T00:43:54,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,395 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,397 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,398 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,400 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,402 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,404 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,405 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,407 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,409 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,411 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,413 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,414 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,416 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,418 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,420 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,421 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,423 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,425 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,427 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,429 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,430 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,432 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,433 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,435 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,437 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,438 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,440 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,442 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,443 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,445 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,447 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,448 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,450 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,452 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,454 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,456 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,457 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,460 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,461 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,463 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,465 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,466 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,468 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,470 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,472 copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,474 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,475 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,477 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,479 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,480 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,482 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,484 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,486 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,487 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,489 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,491 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,493 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,494 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,496 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,498 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,499 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,501 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,503 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2025-11-27T00:43:54,506 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,507 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,509 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,511 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,513 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,514 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,516 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,518 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,520 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,522 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,523 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,525 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,527 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,528 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,530 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,532 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,533 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,535 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,537 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,539 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,541 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,542 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,544 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,546 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,548 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,550 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,551 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,553 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,555 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,557 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,559 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,561 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,562 copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,564 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,566 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,567 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,569 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,571 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,573 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,574 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,576 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,578 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,580 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,582 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,584 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,586 copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,587 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,589 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,591 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,593 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,595 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,597 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,598 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,600 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,602 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,604 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,606 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,608 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,609 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,611 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2025-11-27T00:43:54,614 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,615 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,617 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,619 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,621 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,623 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,624 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,626 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,628 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,630 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,631 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,633 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,635 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,637 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,639 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,641 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,642 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,644 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,646 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,648 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,650 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,652 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,654 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,656 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,657 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,659 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,661 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,663 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,664 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,666 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,668 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,670 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,672 copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,673 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,675 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,677 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,679 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,681 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,683 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,685 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,687 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,689 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,690 copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,692 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,694 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,695 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,697 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,699 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,701 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,703 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,704 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,706 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,708 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,709 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,711 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,713 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,715 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,716 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,718 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,720 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2025-11-27T00:43:54,722 copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2025-11-27T00:43:54,725 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,727 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,728 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,730 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,732 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,734 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,735 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,737 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,739 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,741 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,742 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,744 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,746 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,748 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,749 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,751 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,753 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,755 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,756 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,758 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,760 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,762 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,763 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,765 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,767 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,769 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,770 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,772 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,774 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,776 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,777 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,779 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,781 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,783 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,784 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,786 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,788 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,790 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,791 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,793 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,795 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,796 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,799 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,801 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,802 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,804 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,806 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,808 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,809 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,811 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,813 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,815 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,817 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,818 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,820 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,822 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,823 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,825 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,827 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,828 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,830 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2025-11-27T00:43:54,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016 2025-11-27T00:43:54,833 copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2025-11-27T00:43:54,835 copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2025-11-27T00:43:54,837 copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2025-11-27T00:43:54,840 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval 2025-11-27T00:43:54,841 copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,844 copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,846 copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,847 copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,849 copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,851 copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,852 copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,854 copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,856 copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,858 copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,860 copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,862 copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,863 copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,865 copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,867 copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,869 copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,870 copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,872 copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,874 copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,876 copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,877 copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,879 copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,880 copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,882 copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,884 copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,886 copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,888 copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2025-11-27T00:43:54,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval 2025-11-27T00:43:54,891 copying build/lib/lm_eval/tasks/humaneval/humaneval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,893 copying build/lib/lm_eval/tasks/humaneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,895 copying build/lib/lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,897 copying build/lib/lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,899 copying build/lib/lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,901 copying build/lib/lm_eval/tasks/humaneval/humaneval_64.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,902 copying build/lib/lm_eval/tasks/humaneval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2025-11-27T00:43:54,905 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu 2025-11-27T00:43:54,906 copying build/lib/lm_eval/tasks/global_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu 2025-11-27T00:43:54,908 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default 2025-11-27T00:43:54,910 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,911 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,913 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,915 copying build/lib/lm_eval/tasks/global_mmlu/default/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,917 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,919 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,920 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,922 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,924 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,925 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2025-11-27T00:43:54,928 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,929 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,930 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,932 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,934 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,935 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,937 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,939 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,941 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,943 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2025-11-27T00:43:54,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,946 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,948 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,950 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,951 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,953 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,955 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,957 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,959 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,960 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2025-11-27T00:43:54,963 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,964 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,965 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,967 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,969 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,971 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,972 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,974 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,975 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,977 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2025-11-27T00:43:54,980 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,981 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,982 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,984 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,986 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,987 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,989 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,991 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,993 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,994 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2025-11-27T00:43:54,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:54,998 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,000 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,001 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,003 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,005 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,006 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,008 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,010 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,011 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2025-11-27T00:43:55,014 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,015 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,016 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,018 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,020 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,022 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,024 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,025 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,027 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,029 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2025-11-27T00:43:55,031 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,032 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,034 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,036 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,038 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,040 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,041 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,043 copying build/lib/lm_eval/tasks/global_mmlu/default/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,045 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,046 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2025-11-27T00:43:55,048 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,049 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,051 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,053 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,055 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,056 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,058 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,060 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,062 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,063 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2025-11-27T00:43:55,066 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,067 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,069 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,070 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,072 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,074 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,076 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,078 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,079 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,081 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2025-11-27T00:43:55,084 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,084 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,086 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,088 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,089 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,091 copying build/lib/lm_eval/tasks/global_mmlu/default/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,093 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,094 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,096 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,098 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2025-11-27T00:43:55,100 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,101 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,103 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,104 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,106 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,108 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,110 copying build/lib/lm_eval/tasks/global_mmlu/default/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,112 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,113 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,115 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2025-11-27T00:43:55,117 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,119 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,120 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,122 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,124 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,126 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,127 copying build/lib/lm_eval/tasks/global_mmlu/default/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,129 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,131 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,133 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2025-11-27T00:43:55,135 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,136 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,138 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,140 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,142 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,143 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,145 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,147 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,148 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,150 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2025-11-27T00:43:55,152 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,153 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,155 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,157 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,159 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,160 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,162 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,164 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,166 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,167 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2025-11-27T00:43:55,170 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full 2025-11-27T00:43:55,173 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,174 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,176 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,178 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,180 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,182 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,189 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,191 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,192 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,194 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,196 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,198 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,199 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,201 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,203 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,205 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,206 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,209 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,210 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,212 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,214 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,216 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,217 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,219 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,221 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,223 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,224 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,226 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,228 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,229 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,231 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,233 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,235 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,236 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,238 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,240 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,242 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,244 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,246 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,247 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,249 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,251 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,253 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,254 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,256 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,258 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,260 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,261 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,263 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,265 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,266 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,268 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,270 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,272 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,274 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,275 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,277 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,279 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,281 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,282 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,284 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,286 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2025-11-27T00:43:55,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,290 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,292 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,294 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,295 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,297 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,299 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,301 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,302 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,304 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,306 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,308 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,309 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,311 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,313 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,315 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,316 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,318 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,320 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,322 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,323 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,325 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,327 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,329 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,330 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,332 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,334 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,335 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,337 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,339 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,341 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,343 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,344 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,346 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,348 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,350 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,352 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,354 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,355 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,357 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,359 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,361 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,363 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,364 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,366 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,368 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,369 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,371 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,373 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,375 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,376 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,378 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,380 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,381 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,383 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,385 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,387 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,389 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,390 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,392 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,394 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,396 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,397 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,399 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,401 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2025-11-27T00:43:55,404 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,405 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,407 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,408 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,410 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,412 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,414 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,415 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,417 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,419 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,421 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,423 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,424 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,426 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,428 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,429 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,431 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,433 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,435 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,436 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,438 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,440 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,442 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,443 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,445 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,447 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,448 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,450 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,452 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,454 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,455 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,457 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,459 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,461 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,463 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,464 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,466 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,468 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,470 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,472 copying build/lib/lm_eval/tasks/global_mmlu/full/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,474 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,475 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,477 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,479 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,480 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,482 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,484 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,485 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,487 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,489 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,491 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,492 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,494 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,496 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,498 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,500 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,501 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,503 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,505 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,507 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,509 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,511 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,512 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,514 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,516 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2025-11-27T00:43:55,519 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,521 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,522 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,524 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,526 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,528 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,530 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,532 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,533 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,535 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,537 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,539 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,541 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,543 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,544 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,546 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,548 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,550 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,551 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,553 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,555 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,556 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,558 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,560 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,561 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,563 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,565 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,567 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,568 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,570 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,572 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,574 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,575 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,577 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,579 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,581 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,582 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,584 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,586 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,588 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,590 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,591 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,593 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,595 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,596 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,598 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,600 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,601 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,603 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,605 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,606 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,608 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,610 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,612 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,614 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,615 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,617 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,619 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,621 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,622 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,624 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,626 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,628 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,629 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,631 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2025-11-27T00:43:55,634 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,635 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,637 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,639 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,640 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,642 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,644 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,645 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,647 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,649 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,651 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,653 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,655 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,657 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,659 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,660 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,662 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,664 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,666 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,668 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,670 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,671 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,673 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,675 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,676 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,679 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,680 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,682 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,684 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,685 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,687 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,689 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,691 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,693 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,694 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,696 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,698 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,700 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,702 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,703 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,705 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,707 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,709 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,710 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,712 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,714 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,715 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,717 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,719 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,721 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,722 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,724 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,726 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,728 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,729 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,731 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,733 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,735 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,736 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,738 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,740 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,742 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,743 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,745 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,747 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2025-11-27T00:43:55,750 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,751 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,753 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,755 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,757 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,759 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,761 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,763 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,765 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,766 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,768 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,770 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,772 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,774 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,776 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,777 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,779 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,781 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,783 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,785 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,787 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,789 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,790 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,792 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,794 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,796 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,797 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,799 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,801 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,803 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,805 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,806 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,808 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,810 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,812 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,814 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,816 copying build/lib/lm_eval/tasks/global_mmlu/full/el/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,818 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,819 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,821 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,823 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,825 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,827 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,829 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,830 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,832 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,834 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,836 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,837 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,839 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,841 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,843 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,844 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,846 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,848 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,850 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,852 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,853 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,855 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,857 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,859 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,861 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,862 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,864 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,866 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2025-11-27T00:43:55,869 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,870 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,872 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,874 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,876 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,878 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,879 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,881 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,883 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,885 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,887 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,889 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,891 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,892 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,894 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,896 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,898 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,900 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,902 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,904 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,906 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,907 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,909 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,911 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,913 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,915 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,916 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,918 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,920 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,922 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,924 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,926 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,927 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,929 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,931 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,933 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,935 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,937 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,939 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,941 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,943 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,945 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,947 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,949 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,950 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,952 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,954 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,956 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,958 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,959 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,961 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,963 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,965 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,967 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,969 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,971 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,972 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,974 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,976 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,978 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,980 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,982 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,984 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,986 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,988 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2025-11-27T00:43:55,991 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:55,992 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:55,994 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:55,996 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:55,998 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,000 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,002 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,003 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,005 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,007 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,009 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,011 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,013 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,015 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,016 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,018 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,020 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,022 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,024 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,026 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,028 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,030 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,032 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,034 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,035 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,037 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,039 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,041 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,043 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,044 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,046 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,048 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,050 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,052 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,054 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,056 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,058 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,060 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,062 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,064 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,066 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,068 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,070 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,072 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,074 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,075 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,077 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,079 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,081 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,083 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,084 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,086 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,088 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,090 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,092 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,094 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,096 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,098 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,100 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,102 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,104 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,106 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,108 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,110 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,112 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2025-11-27T00:43:56,115 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,117 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,120 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,122 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,124 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,125 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,127 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,129 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,131 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,133 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,135 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,137 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,138 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,140 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,142 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,144 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,146 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,148 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,150 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,151 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,153 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,155 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,157 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,159 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,161 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,162 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,164 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,166 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,168 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,170 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,172 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,174 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,176 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,178 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,180 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,181 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,189 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,191 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,193 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,195 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,197 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,199 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,201 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,202 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,204 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,206 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,208 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,210 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,211 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,213 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,215 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,217 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,219 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,221 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,223 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,225 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,226 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,228 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,230 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,232 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,234 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,236 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2025-11-27T00:43:56,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,246 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,249 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,253 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,259 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,260 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,262 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,264 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,266 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,268 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,270 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,272 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,274 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,276 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,278 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,280 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,282 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,284 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,286 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,287 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,289 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,291 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,293 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,295 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,297 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,299 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,300 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,302 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,304 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,306 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,308 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,310 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,312 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,315 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,317 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,319 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,321 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,323 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,326 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,328 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,330 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,333 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,335 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,337 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,345 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,346 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,348 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,358 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2025-11-27T00:43:56,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,362 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,364 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,366 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,368 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,370 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,375 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,377 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,379 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,381 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,383 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,385 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,388 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,392 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,396 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,398 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,400 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,402 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,404 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,405 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,407 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,409 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,411 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,413 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,415 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,420 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,422 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,424 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,426 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,428 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,430 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,432 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,434 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,435 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,437 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,439 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,441 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,443 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,445 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,447 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,449 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,450 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,452 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,454 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,456 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,458 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,460 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,462 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,463 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,465 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,467 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,469 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,470 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,472 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,474 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,476 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,477 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,479 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2025-11-27T00:43:56,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,484 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,486 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,488 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,490 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,492 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,493 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,495 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,497 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,499 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,501 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,502 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,504 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,506 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,508 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,510 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,512 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,514 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,516 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,517 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,519 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,521 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,523 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,525 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,527 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,528 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,530 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,532 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,534 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,535 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,537 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,539 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,541 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,543 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,545 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,547 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,549 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,551 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,552 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,554 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,556 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,558 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,560 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,562 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,563 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,565 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,567 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,569 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,570 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,572 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,574 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,576 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,577 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,579 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,581 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,583 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,585 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,587 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,588 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,590 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,592 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,594 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,596 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,598 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,600 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2025-11-27T00:43:56,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,604 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,606 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,608 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,610 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,612 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,614 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,616 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,617 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,619 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,621 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,623 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,625 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,627 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,629 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,630 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,632 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,634 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,636 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,638 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,640 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,642 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,643 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,645 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,647 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,649 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,651 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,652 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,654 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,656 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,658 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,659 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,661 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,663 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,665 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,667 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,669 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,670 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,672 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,674 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,676 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,678 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,680 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,682 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,684 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,685 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,687 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,690 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,691 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,693 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,695 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,697 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,699 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,701 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,703 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,704 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,706 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,708 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,710 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,712 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,714 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,716 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,718 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,719 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,721 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2025-11-27T00:43:56,725 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,726 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,728 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,730 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,732 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,734 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,735 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,737 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,739 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,741 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,743 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,744 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,746 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,748 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,750 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,752 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,753 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,755 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,757 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,759 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,761 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,762 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,764 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,766 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,768 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,770 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,772 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,773 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,775 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,777 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,779 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,780 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,782 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,784 copying build/lib/lm_eval/tasks/global_mmlu/full/he/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,786 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,788 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,790 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,792 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,794 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,796 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,798 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,800 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,802 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,804 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,806 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,808 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,810 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,812 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,814 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,816 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,818 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,820 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,821 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,823 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,825 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,827 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,829 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,831 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,833 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,834 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,836 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,838 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,840 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,842 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,844 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2025-11-27T00:43:56,848 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,849 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,851 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,853 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,855 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,860 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,862 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,864 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,865 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,867 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,869 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,871 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,873 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,875 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,876 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,878 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,880 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,882 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,884 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,886 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,888 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,891 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,892 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,894 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,896 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,898 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,900 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,902 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,904 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,906 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,908 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,910 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,911 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,913 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,915 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,917 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,919 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,922 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,924 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,926 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,928 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,930 copying build/lib/lm_eval/tasks/global_mmlu/full/am/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,932 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,933 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,935 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,937 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,939 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,941 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,943 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,944 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,946 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,948 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,950 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,951 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,953 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,955 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,957 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,959 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,961 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,963 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,965 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,966 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,968 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,970 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,972 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2025-11-27T00:43:56,976 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,977 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,979 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,981 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,983 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,984 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,986 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,988 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,990 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,992 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,994 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,996 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,997 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:56,999 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,001 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,003 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,005 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,007 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,009 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,011 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,013 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,015 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,017 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,019 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,020 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,022 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,024 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,026 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,028 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,030 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,032 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,033 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,035 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,037 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,039 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,041 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,043 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,045 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,047 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,048 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,050 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,052 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,054 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,056 copying build/lib/lm_eval/tasks/global_mmlu/full/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,058 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,060 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,062 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,064 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,066 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,068 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,069 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,071 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,073 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,075 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,077 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,079 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,081 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,083 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,085 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,086 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,088 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,090 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,092 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,094 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,096 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2025-11-27T00:43:57,099 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,101 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,103 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,104 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,106 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,108 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,110 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,112 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,113 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,115 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,118 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,120 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,123 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,125 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,127 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,129 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,131 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,133 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,135 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,137 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,139 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,140 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,142 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,144 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,146 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,148 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,150 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,152 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,154 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,155 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,157 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,159 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,161 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,163 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,165 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,166 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,169 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,170 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,172 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,174 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,176 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,178 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,180 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,182 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,184 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,186 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,188 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,189 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,191 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,193 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,195 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,197 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,198 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,200 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,202 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,204 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,206 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,207 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,209 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,211 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,213 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,215 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,216 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,218 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,220 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2025-11-27T00:43:57,224 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,225 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,227 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,229 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,231 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,232 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,234 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,236 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,238 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,240 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,241 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,243 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,245 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,247 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,249 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,251 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,253 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,254 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,256 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,258 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,260 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,262 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,264 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,266 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,268 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,269 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,271 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,273 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,275 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,277 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,279 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,280 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,282 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,284 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,286 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,288 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,290 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,292 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,294 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,295 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,297 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,299 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,301 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,303 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,305 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,307 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,309 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,310 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,312 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,314 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,316 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,318 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,319 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,321 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,323 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,325 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,327 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,329 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,331 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,332 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,334 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,336 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,338 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,340 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,342 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2025-11-27T00:43:57,345 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,346 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,349 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,358 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,360 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,362 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,363 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,365 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,367 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,369 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,371 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,373 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,375 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,377 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,379 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,380 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,382 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,388 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,392 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,395 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,397 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,399 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,401 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,403 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,405 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,407 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,409 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,411 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,413 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,415 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,421 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,423 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,425 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,426 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,428 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,430 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,432 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,434 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,436 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,438 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,440 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,442 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,443 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,445 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,447 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,449 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,451 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,453 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,455 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,457 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,459 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,461 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,462 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,464 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,466 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2025-11-27T00:43:57,470 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,471 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,473 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,475 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,477 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,479 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,481 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,483 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,485 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,487 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,489 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,490 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,492 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,494 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,496 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,498 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,500 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,503 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,505 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,507 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,509 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,511 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,513 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,515 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,517 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,519 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,520 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,522 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,524 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,526 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,528 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,530 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,531 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,533 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,535 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,537 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,539 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,541 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,542 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,545 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,546 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,548 copying build/lib/lm_eval/tasks/global_mmlu/full/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,550 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,552 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,554 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,556 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,559 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,561 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,562 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,564 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,566 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,568 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,570 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,572 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,574 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,576 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,578 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,580 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,582 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,583 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,585 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,587 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,589 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,591 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,593 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2025-11-27T00:43:57,597 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,598 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,600 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,602 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,604 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,606 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,608 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,610 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,612 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,614 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,616 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,618 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,620 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,621 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,623 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,625 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,627 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,629 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,631 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,633 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,635 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,637 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,639 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,641 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,643 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,645 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,646 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,648 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,650 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,652 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,654 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,656 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,658 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,659 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,661 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,663 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,665 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,667 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,669 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,670 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,672 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,674 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,676 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,678 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,680 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,682 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,684 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,685 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,687 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,689 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,691 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,693 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,695 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,696 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,698 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,700 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,702 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,704 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,706 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,707 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,709 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,711 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,713 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,715 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,717 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2025-11-27T00:43:57,721 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,722 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,724 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,726 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,728 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,730 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,731 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,733 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,735 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,737 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,739 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,741 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,742 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,744 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,746 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,748 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,750 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,752 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,754 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,756 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,758 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,759 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,761 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,763 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,765 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,767 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,769 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,771 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,773 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,774 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,776 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,778 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,780 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,782 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,783 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,785 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,787 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,789 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,791 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,793 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,794 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,796 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,798 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,800 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,802 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,804 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,806 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,808 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,810 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,811 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,813 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,815 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,817 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,819 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,821 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,823 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,825 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,827 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,828 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,830 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,832 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,834 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,836 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,838 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,840 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2025-11-27T00:43:57,844 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,845 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,847 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,849 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,851 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,853 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,854 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,856 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,858 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,860 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,863 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,865 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,868 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,870 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,872 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,874 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,876 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,878 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,879 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,881 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,883 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,885 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,888 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,890 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,892 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,894 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,895 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,897 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,899 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,901 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,903 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,905 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,912 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,926 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,928 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,930 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,933 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,935 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,937 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,939 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,940 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,944 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,946 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,948 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,950 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,952 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,954 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,956 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,958 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,960 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,962 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2025-11-27T00:43:57,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,967 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,969 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,971 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,973 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,975 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,977 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,979 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,980 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,982 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,984 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,986 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,988 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,990 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,992 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,994 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,995 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:57,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,003 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,005 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,007 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,009 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,011 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,013 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,014 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,016 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,018 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,020 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,022 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,024 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,026 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,028 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,030 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,032 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,034 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,035 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,037 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,039 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,041 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,043 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,045 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,047 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,049 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,051 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,053 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,055 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,057 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,059 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,060 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,062 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,064 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,066 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,068 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,070 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,072 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,074 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,076 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,078 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,079 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,081 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,083 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,085 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,087 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2025-11-27T00:43:58,090 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,092 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,094 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,096 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,098 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,099 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,101 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,103 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,105 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,107 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,109 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,110 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,112 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,114 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,116 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,118 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,120 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,122 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,124 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,126 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,128 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,130 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,131 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,133 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,135 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,137 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,139 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,141 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,143 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,145 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,147 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,148 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,150 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,152 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,154 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,156 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,158 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,160 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,162 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,164 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,166 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,168 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,170 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,172 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,173 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,175 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,177 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,179 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,181 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,189 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,190 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,192 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,194 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,196 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,198 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,200 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,202 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,204 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,206 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,207 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,209 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,211 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2025-11-27T00:43:58,215 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,216 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,218 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,220 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,222 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,224 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,226 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,228 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,230 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,231 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,233 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,235 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,237 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,246 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,248 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,249 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,253 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,255 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,257 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,259 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,260 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,262 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,264 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,266 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,268 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,269 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,271 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,275 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,277 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,279 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,281 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,283 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,285 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,286 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,288 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,290 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,292 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,296 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,298 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,300 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,302 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,304 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,306 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,315 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,317 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,319 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,321 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,323 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,326 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,328 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,330 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,332 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2025-11-27T00:43:58,338 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,339 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,341 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,343 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,345 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,347 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,348 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,350 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,352 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,354 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,355 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,357 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,359 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,361 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,363 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,365 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,367 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,369 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,371 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,373 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,374 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,376 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,378 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,380 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,382 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,384 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,386 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,388 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,390 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,391 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,393 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,395 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,397 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,399 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,401 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,403 copying build/lib/lm_eval/tasks/global_mmlu/full/so/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,404 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,406 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,408 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,410 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,412 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,414 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,416 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,418 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,420 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,421 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,423 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,425 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,427 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,429 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,431 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,433 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,435 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,436 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,438 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,440 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,442 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,444 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,446 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,448 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,450 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,452 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,454 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,456 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,458 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2025-11-27T00:43:58,461 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,462 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,464 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,466 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,468 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,470 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,471 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,473 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,475 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,477 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,479 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,480 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,482 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,484 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,485 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,487 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,489 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,491 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,492 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,494 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,496 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,498 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,500 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,502 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,504 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,505 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,507 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,509 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,511 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,513 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,514 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,516 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,518 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,520 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,522 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,523 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,525 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,527 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,529 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,531 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,533 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,534 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,536 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,538 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,540 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,542 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,544 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,546 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,548 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,550 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,552 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,554 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,556 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,558 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,559 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,561 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,563 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,565 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,567 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,569 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,571 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,572 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,574 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,576 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,578 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2025-11-27T00:43:58,582 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,583 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,585 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,587 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,589 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,591 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,592 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,594 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,596 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,598 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,600 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,601 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,603 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,605 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,607 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,609 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,610 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,612 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,614 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,616 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,618 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,620 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,621 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,623 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,625 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,627 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,629 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,631 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,633 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,635 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,636 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,638 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,640 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,642 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,644 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,645 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,647 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,649 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,651 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,653 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,655 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,657 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,659 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,660 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,662 copying build/lib/lm_eval/tasks/global_mmlu/full/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,664 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,666 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,668 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,670 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,672 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,674 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,676 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,678 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,679 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,681 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,683 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,685 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,687 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,689 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,691 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,693 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,695 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,697 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,699 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,701 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2025-11-27T00:43:58,705 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,706 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,708 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,710 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,712 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,714 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,716 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,717 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,719 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,721 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,723 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,725 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,727 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,729 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,731 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,733 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,734 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,736 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,738 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,740 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,742 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,744 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,746 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,748 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,750 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,752 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,754 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,756 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,758 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,760 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,762 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,764 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,766 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,767 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,769 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,771 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,773 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,775 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,777 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,779 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,780 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,782 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,784 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,786 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,788 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,790 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,792 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,794 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,795 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,797 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,799 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,801 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,803 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,805 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,807 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,809 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,811 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,813 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,815 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,817 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,819 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,820 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,822 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,824 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,826 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2025-11-27T00:43:58,830 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,831 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,833 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,835 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,837 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,839 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,841 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,843 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,844 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,846 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,848 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,850 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,852 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,854 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,856 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,857 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,859 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,861 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,863 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,865 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,867 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,869 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,871 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,873 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,875 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,877 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,879 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,881 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,883 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,885 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,887 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,888 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,890 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,892 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,894 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,896 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,898 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,900 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,901 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,903 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,905 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,907 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,909 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,911 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,913 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,914 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,916 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,918 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,920 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,922 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,924 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,926 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,927 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,929 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,931 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,933 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,935 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,937 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,938 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,940 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,942 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,944 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,946 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,948 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,950 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2025-11-27T00:43:58,954 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,955 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,957 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,959 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,961 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,962 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,964 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,966 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,968 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,970 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,971 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,973 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,975 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,977 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,979 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,981 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,983 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,984 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,986 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,988 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,990 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,992 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,994 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,996 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:58,998 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,000 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,002 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,003 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,005 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,007 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,009 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,011 copying build/lib/lm_eval/tasks/global_mmlu/full/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,013 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,015 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,016 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,018 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,020 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,022 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,024 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,026 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,027 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,029 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,031 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,033 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,035 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,037 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,039 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,041 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,043 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,045 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,047 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,048 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,050 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,052 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,054 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,056 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,058 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,059 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,061 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,063 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,065 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,067 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,069 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,071 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,073 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2025-11-27T00:43:59,077 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,078 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,080 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,082 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,084 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,086 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,087 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,090 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,091 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,093 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,095 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,097 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,099 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,100 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,102 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,104 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,106 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,108 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,110 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,112 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,114 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,116 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,118 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,120 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,121 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,123 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,125 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,127 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,129 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,131 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,133 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,135 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,136 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,139 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,140 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,142 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,144 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,146 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,148 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,150 copying build/lib/lm_eval/tasks/global_mmlu/full/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,151 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,153 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,155 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,157 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,159 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,161 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,163 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,165 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,167 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,169 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,171 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,172 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,174 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,176 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,178 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,179 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,181 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,183 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,185 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,187 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,188 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,190 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,192 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,194 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,196 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2025-11-27T00:43:59,200 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,201 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,203 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,205 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,206 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,208 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,210 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,212 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,214 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,216 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,218 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,219 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,221 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,223 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,225 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,227 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,229 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,231 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,233 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,234 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,236 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,239 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,240 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,242 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,244 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,246 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,248 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,250 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,252 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,255 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,256 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,258 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,260 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,262 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,264 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,266 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,267 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,269 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,271 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,273 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,275 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,277 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,279 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,281 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,282 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,284 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,286 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,289 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,290 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,292 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,294 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,296 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,298 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,300 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,302 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,304 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,306 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,307 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,309 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,311 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,313 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,315 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,317 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,319 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,321 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2025-11-27T00:43:59,325 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,326 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,328 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,329 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,331 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,333 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,335 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,337 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,339 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,340 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,342 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,344 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,346 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,347 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,349 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,351 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,353 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,355 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,357 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,359 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,360 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,362 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,364 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,366 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,368 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,370 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,372 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,373 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,375 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,377 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,379 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,381 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,383 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,385 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,386 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,388 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,390 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,392 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,394 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,395 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,397 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,399 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,401 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,403 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,405 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,406 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,408 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,410 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,412 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,414 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,416 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,417 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,419 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,421 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,423 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,425 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,426 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,428 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,430 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,432 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,434 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,435 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,437 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,439 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,441 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2025-11-27T00:43:59,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,445 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,447 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,449 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,451 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,453 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,455 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,457 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,459 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,461 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,463 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,464 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,466 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,468 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,470 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,472 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,474 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,476 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,478 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,480 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,482 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,484 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,486 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,488 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,490 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,492 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,494 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,496 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,498 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,500 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,501 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,503 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,505 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,507 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,509 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,511 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,512 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,514 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,516 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,518 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,520 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,522 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,524 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,526 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,528 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,530 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,532 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,534 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,536 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,537 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,540 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,541 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,543 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,545 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,547 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,549 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,551 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,552 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,554 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,556 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,558 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,560 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,562 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,564 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,566 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2025-11-27T00:43:59,569 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,570 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,572 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,574 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,576 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,578 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,580 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,582 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,584 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,586 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,587 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,589 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,591 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,593 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,595 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,597 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,599 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,600 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,602 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,604 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,606 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,608 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,609 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,611 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,613 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,615 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,617 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,618 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,620 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,622 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,624 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,626 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,627 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,629 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,631 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,633 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,635 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,637 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,638 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,640 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,642 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,644 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,646 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,648 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,650 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,652 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,653 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,655 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,657 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,659 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,661 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,663 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,665 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,667 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,668 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,670 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,672 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,674 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,676 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,677 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,679 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,681 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,683 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,685 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,687 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2025-11-27T00:43:59,691 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,692 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,694 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,696 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,698 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,700 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,702 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,704 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,706 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,707 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,709 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,711 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,713 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,715 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,717 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,719 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,721 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,723 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,725 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,727 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,728 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,730 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,732 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,734 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,736 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,738 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,739 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,741 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,743 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,745 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,747 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,749 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,751 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,753 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,754 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,756 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,758 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,760 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,762 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,764 copying build/lib/lm_eval/tasks/global_mmlu/full/si/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,767 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,769 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,771 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,774 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,776 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,778 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,780 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,782 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,783 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,785 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,787 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,789 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,790 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,792 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,794 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,795 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,797 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,799 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,800 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,802 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,804 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,805 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,807 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,809 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,811 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2025-11-27T00:43:59,814 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,815 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,817 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,819 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,821 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,822 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,824 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,826 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,828 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,830 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,832 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,833 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,835 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,837 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,838 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,840 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,842 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,844 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,846 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,848 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,850 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,852 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,853 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,855 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,857 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,859 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,862 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,864 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,866 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,868 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,870 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,871 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,873 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,875 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,877 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,879 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,882 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,884 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,887 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,894 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,896 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,898 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,900 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,902 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,903 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,905 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,907 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,909 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,911 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,913 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,921 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,923 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,925 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,928 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2025-11-27T00:43:59,932 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,933 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,935 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,936 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,938 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,940 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,944 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,946 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,949 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,951 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,952 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,954 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,956 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,958 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,960 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,962 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,963 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,965 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,967 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,969 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,971 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,972 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,980 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,982 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,983 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,985 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,987 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,989 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,991 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,992 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,994 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,996 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:43:59,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,003 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,004 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,006 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,008 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,010 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,011 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,013 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,015 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,017 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,019 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,020 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,022 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,024 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,026 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,028 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,029 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,031 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,033 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,034 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,036 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,038 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,039 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,041 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,043 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,045 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2025-11-27T00:44:00,048 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,049 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,051 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,052 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,054 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,056 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,058 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,060 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,062 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,063 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,065 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,067 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,068 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,070 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,072 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,073 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,075 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,077 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,079 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,080 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,082 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,084 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,086 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,087 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,089 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,091 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,092 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,094 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,096 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,098 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,100 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,102 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,104 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,105 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,108 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,109 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,111 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,113 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,115 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,116 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,118 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,120 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,122 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,123 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,125 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,127 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,129 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,131 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,133 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,134 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,136 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,138 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,140 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,142 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,144 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,145 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,147 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,149 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,151 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,152 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,154 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,156 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,158 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,160 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,162 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2025-11-27T00:44:00,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,166 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,168 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,170 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,172 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,174 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,175 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,177 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,179 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,181 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,183 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,184 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,186 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,188 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,190 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,191 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,193 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,195 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,197 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,199 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,201 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,203 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,205 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,206 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,208 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,210 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,212 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,214 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,215 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,217 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,219 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,221 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,223 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,224 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,226 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,228 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,230 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,232 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,233 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,235 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,237 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,239 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,241 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,242 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,244 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,246 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,248 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,250 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,251 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,253 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,255 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,257 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,259 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,261 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,262 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,264 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,266 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,268 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,269 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,271 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,273 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,274 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,276 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,278 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,280 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2025-11-27T00:44:00,283 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/histoires_morales 2025-11-27T00:44:00,284 copying build/lib/lm_eval/tasks/histoires_morales/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2025-11-27T00:44:00,286 copying build/lib/lm_eval/tasks/histoires_morales/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2025-11-27T00:44:00,288 copying build/lib/lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2025-11-27T00:44:00,290 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cabbq 2025-11-27T00:44:00,291 copying build/lib/lm_eval/tasks/cabbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,293 copying build/lib/lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,295 copying build/lib/lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,297 copying build/lib/lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,299 copying build/lib/lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,301 copying build/lib/lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,303 copying build/lib/lm_eval/tasks/cabbq/cabbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,304 copying build/lib/lm_eval/tasks/cabbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,307 copying build/lib/lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,308 copying build/lib/lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,310 copying build/lib/lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,312 copying build/lib/lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,314 copying build/lib/lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,316 copying build/lib/lm_eval/tasks/cabbq/cabbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2025-11-27T00:44:00,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,319 copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,321 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,323 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,325 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,327 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,329 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,331 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,332 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,334 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,336 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,338 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,340 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,342 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,344 copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,345 copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,347 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,349 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,351 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,353 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,354 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,356 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,358 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,360 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,362 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2025-11-27T00:44:00,366 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,367 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,369 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,371 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,372 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,374 copying build/lib/lm_eval/tasks/evalita_llm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,376 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,378 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,380 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,382 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,384 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,386 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,387 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,389 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,391 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,393 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,395 copying build/lib/lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,397 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,399 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,401 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,402 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,404 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,406 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,408 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,410 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,411 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,413 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,415 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,417 copying build/lib/lm_eval/tasks/evalita_llm/_at_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,420 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,422 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,423 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,425 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,427 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,429 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,431 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,433 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,435 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,437 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,439 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,441 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,443 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,445 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,447 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,449 copying build/lib/lm_eval/tasks/evalita_llm/sum_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,452 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,456 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,459 copying build/lib/lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,462 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,464 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,465 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,467 copying build/lib/lm_eval/tasks/evalita_llm/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,469 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,472 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,474 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,476 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,478 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,480 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,482 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,484 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,486 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,487 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,490 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,492 copying build/lib/lm_eval/tasks/evalita_llm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,494 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,496 copying build/lib/lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,498 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,500 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,502 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,504 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,506 copying build/lib/lm_eval/tasks/evalita_llm/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,508 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,510 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,512 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,514 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,516 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,518 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,519 copying build/lib/lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,521 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,523 copying build/lib/lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,525 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,527 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,529 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,531 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,533 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,534 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,537 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,539 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,542 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,545 copying build/lib/lm_eval/tasks/evalita_llm/_re_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,547 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,549 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,550 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,552 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2025-11-27T00:44:00,555 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2 2025-11-27T00:44:00,556 copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2025-11-27T00:44:00,558 copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2025-11-27T00:44:00,560 copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2025-11-27T00:44:00,562 copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2025-11-27T00:44:00,565 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meddialog 2025-11-27T00:44:00,567 copying build/lib/lm_eval/tasks/meddialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,569 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,571 copying build/lib/lm_eval/tasks/meddialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,573 copying build/lib/lm_eval/tasks/meddialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,575 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,577 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,578 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2025-11-27T00:44:00,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa 2025-11-27T00:44:00,582 copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2025-11-27T00:44:00,584 copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2025-11-27T00:44:00,586 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble 2025-11-27T00:44:00,587 copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,589 copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,591 copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,593 copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,595 copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,597 copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2025-11-27T00:44:00,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa 2025-11-27T00:44:00,600 copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2025-11-27T00:44:00,602 copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2025-11-27T00:44:00,605 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench 2025-11-27T00:44:00,606 copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:00,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,613 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,615 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,617 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,619 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,620 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,622 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,624 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,626 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,627 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,629 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,631 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,632 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,634 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,636 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,637 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,639 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,641 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,643 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,644 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,646 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,648 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,650 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,652 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,653 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,655 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,657 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,659 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,661 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,663 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,665 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,666 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,668 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,670 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,671 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,673 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,675 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,677 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,678 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,680 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,682 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,684 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,685 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,687 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,689 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,691 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,692 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,694 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,696 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,698 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,699 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,701 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,703 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,705 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,706 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,708 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,710 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,712 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,713 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,715 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,716 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,718 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,720 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,722 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,723 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,725 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,727 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,729 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,731 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,733 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,734 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,736 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,738 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,740 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,742 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,744 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,745 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,747 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,749 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,751 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,753 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,754 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,756 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,758 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,759 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,761 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,763 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,765 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,767 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,769 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,771 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,772 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,774 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,776 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,777 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,779 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,781 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,783 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,785 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,786 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,788 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,790 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,792 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,793 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,795 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,797 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,799 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,800 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,802 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,804 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,806 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,808 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,809 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,811 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,813 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,815 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,817 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,818 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,820 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,822 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2025-11-27T00:44:00,824 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:00,825 copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:00,828 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:00,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,833 copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,835 copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,837 copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,839 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,841 copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,843 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,844 copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,846 copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,848 copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,850 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,852 copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,853 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,855 copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,857 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,859 copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,860 copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,862 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,864 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,866 copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,867 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,869 copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,871 copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,872 copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,874 copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,876 copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,877 copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,879 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,881 copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,882 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,884 copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,886 copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,887 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,890 copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,891 copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,893 copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,895 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,897 copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,899 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,900 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,902 copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,904 copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,906 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,907 copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,909 copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,910 copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,912 copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,914 copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,915 copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,917 copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,919 copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,921 copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,922 copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,924 copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,926 copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,928 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,929 copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,931 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,933 copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,934 copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,936 copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,938 copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,940 copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,942 copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,944 copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,946 copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,947 copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,949 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,950 copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,952 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,954 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,956 copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,958 copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,960 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,962 copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,964 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,966 copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,968 copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,970 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,972 copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,974 copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,976 copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,978 copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,981 copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,983 copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,985 copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,987 copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,989 copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,991 copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,993 copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,995 copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,997 copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:00,999 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,001 copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,003 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,005 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,007 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,009 copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,011 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,013 copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,015 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,017 copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,019 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,021 copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,023 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,025 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,027 copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,029 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,031 copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,034 copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,036 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,038 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,040 copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,042 copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,044 copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,046 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,048 copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,050 copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,052 copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,054 copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,056 copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,058 copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,060 copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,062 copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,064 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,066 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,068 copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,070 copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,071 copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,073 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,075 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,077 copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,078 copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,080 copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,082 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,083 copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,085 copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,087 copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,089 copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,090 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,092 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,094 copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,095 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,097 copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,099 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,101 copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,102 copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,104 copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,106 copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,108 copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,110 copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,112 copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,113 copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,115 copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,117 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,120 copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,122 copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,125 copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,127 copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,129 copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,131 copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,133 copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,135 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,138 copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,140 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,142 copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,144 copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,147 copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2025-11-27T00:44:01,149 copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:01,151 copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2025-11-27T00:44:01,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela 2025-11-27T00:44:01,156 copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,158 copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,160 copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,163 copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,165 copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,167 copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,170 copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,172 copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,174 copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,177 copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,179 copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,181 copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2025-11-27T00:44:01,184 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,186 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,188 copying build/lib/lm_eval/tasks/mmlu-pro-plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,191 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,193 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,195 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,197 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,200 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,202 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,204 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,206 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,209 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,211 copying build/lib/lm_eval/tasks/mmlu-pro-plus/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,213 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,215 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,217 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,219 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,221 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,223 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2025-11-27T00:44:01,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,226 copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,228 copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,230 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,232 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,233 copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,235 copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,237 copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,238 copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2025-11-27T00:44:01,241 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/libra 2025-11-27T00:44:01,242 copying build/lib/lm_eval/tasks/libra/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,244 copying build/lib/lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,245 copying build/lib/lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,247 copying build/lib/lm_eval/tasks/libra/ru_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,249 copying build/lib/lm_eval/tasks/libra/matreshka_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,250 copying build/lib/lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,252 copying build/lib/lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,254 copying build/lib/lm_eval/tasks/libra/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,255 copying build/lib/lm_eval/tasks/libra/ru_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,257 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,259 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,261 copying build/lib/lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,262 copying build/lib/lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,264 copying build/lib/lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,266 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,267 copying build/lib/lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,269 copying build/lib/lm_eval/tasks/libra/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,271 copying build/lib/lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,273 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,275 copying build/lib/lm_eval/tasks/libra/librusec_mhqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,276 copying build/lib/lm_eval/tasks/libra/ru_gsm100.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,278 copying build/lib/lm_eval/tasks/libra/passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,280 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,282 copying build/lib/lm_eval/tasks/libra/long_context_multiq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,284 copying build/lib/lm_eval/tasks/libra/librusec_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2025-11-27T00:44:01,286 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd 2025-11-27T00:44:01,287 copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,289 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,291 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,292 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,294 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,295 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,297 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,298 copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,300 copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,302 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2025-11-27T00:44:01,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks 2025-11-27T00:44:01,305 copying build/lib/lm_eval/tasks/benchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2025-11-27T00:44:01,307 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan 2025-11-27T00:44:01,308 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2025-11-27T00:44:01,310 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2025-11-27T00:44:01,313 copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2025-11-27T00:44:01,314 copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2025-11-27T00:44:01,316 copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2025-11-27T00:44:01,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:44:01,319 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:44:01,321 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2025-11-27T00:44:01,323 copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2025-11-27T00:44:01,325 copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2025-11-27T00:44:01,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k 2025-11-27T00:44:01,328 copying build/lib/lm_eval/tasks/hrm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k 2025-11-27T00:44:01,330 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,331 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,333 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,335 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,336 copying build/lib/lm_eval/tasks/hrm8k/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,339 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,340 copying build/lib/lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,342 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,343 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2025-11-27T00:44:01,346 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,347 copying build/lib/lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,349 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,350 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,352 copying build/lib/lm_eval/tasks/hrm8k/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,354 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,356 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,357 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,359 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2025-11-27T00:44:01,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs 2025-11-27T00:44:01,362 copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2025-11-27T00:44:01,364 copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2025-11-27T00:44:01,366 copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2025-11-27T00:44:01,368 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue 2025-11-27T00:44:01,369 copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue 2025-11-27T00:44:01,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola 2025-11-27T00:44:01,373 copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola 2025-11-27T00:44:01,375 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli 2025-11-27T00:44:01,376 copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2025-11-27T00:44:01,378 copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2025-11-27T00:44:01,380 copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2025-11-27T00:44:01,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2 2025-11-27T00:44:01,383 copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2 2025-11-27T00:44:01,385 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli 2025-11-27T00:44:01,386 copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli 2025-11-27T00:44:01,389 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp 2025-11-27T00:44:01,390 copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp 2025-11-27T00:44:01,392 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli 2025-11-27T00:44:01,393 copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli 2025-11-27T00:44:01,395 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc 2025-11-27T00:44:01,396 copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc 2025-11-27T00:44:01,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte 2025-11-27T00:44:01,400 copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte 2025-11-27T00:44:01,402 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu 2025-11-27T00:44:01,403 copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,405 copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,407 copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,409 copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,410 copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,412 copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,414 copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,415 copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,417 copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,419 copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,420 copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,422 copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,424 copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,425 copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,427 copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,429 copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,431 copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,432 copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,434 copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,436 copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,437 copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,439 copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,441 copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,443 copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,444 copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,446 copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,448 copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,450 copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,451 copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,453 copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,454 copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,456 copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,458 copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,459 copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,461 copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,463 copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,464 copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,466 copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,468 copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,469 copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2025-11-27T00:44:01,472 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag 2025-11-27T00:44:01,473 copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2025-11-27T00:44:01,475 copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2025-11-27T00:44:01,477 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench 2025-11-27T00:44:01,478 copying build/lib/lm_eval/tasks/darija_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench 2025-11-27T00:44:01,481 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,482 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,484 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,485 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,487 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,489 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,491 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,493 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2025-11-27T00:44:01,495 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,496 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,498 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,499 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,501 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,503 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,504 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,506 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,508 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,510 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2025-11-27T00:44:01,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,513 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,515 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,517 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,519 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,521 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,523 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,524 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,526 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,528 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,530 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,531 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,533 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,535 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,536 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,538 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,540 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,541 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,543 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,545 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,546 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,548 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,550 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,552 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,553 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,555 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,557 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,559 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,561 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,562 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,564 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,566 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,568 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2025-11-27T00:44:01,570 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,571 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,573 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,575 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,577 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,578 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2025-11-27T00:44:01,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babilong 2025-11-27T00:44:01,582 copying build/lib/lm_eval/tasks/babilong/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,584 copying build/lib/lm_eval/tasks/babilong/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,586 copying build/lib/lm_eval/tasks/babilong/babilong_qa14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,588 copying build/lib/lm_eval/tasks/babilong/_babilong_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,590 copying build/lib/lm_eval/tasks/babilong/babilong_qa7.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,591 copying build/lib/lm_eval/tasks/babilong/babilong_qa16.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,593 copying build/lib/lm_eval/tasks/babilong/babilong_qa6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,595 copying build/lib/lm_eval/tasks/babilong/babilong_qa20.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,597 copying build/lib/lm_eval/tasks/babilong/babilong_qa12.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,598 copying build/lib/lm_eval/tasks/babilong/babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,600 copying build/lib/lm_eval/tasks/babilong/babilong_qa13.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,602 copying build/lib/lm_eval/tasks/babilong/babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,604 copying build/lib/lm_eval/tasks/babilong/babilong_qa11.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,605 copying build/lib/lm_eval/tasks/babilong/babilong_qa9.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,607 copying build/lib/lm_eval/tasks/babilong/babilong_qa15.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,609 copying build/lib/lm_eval/tasks/babilong/babilong_qa18.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,611 copying build/lib/lm_eval/tasks/babilong/babilong.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,613 copying build/lib/lm_eval/tasks/babilong/babilong_qa17.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,614 copying build/lib/lm_eval/tasks/babilong/babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,616 copying build/lib/lm_eval/tasks/babilong/babilong_qa8.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,618 copying build/lib/lm_eval/tasks/babilong/babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,619 copying build/lib/lm_eval/tasks/babilong/babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,621 copying build/lib/lm_eval/tasks/babilong/babilong_longctx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,623 copying build/lib/lm_eval/tasks/babilong/babilong_qa10.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,624 copying build/lib/lm_eval/tasks/babilong/babilong_qa19.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2025-11-27T00:44:01,627 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp 2025-11-27T00:44:01,629 copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,631 copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,632 copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,634 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,636 copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,637 copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,639 copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,641 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,642 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,644 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,646 copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,648 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,650 copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,652 copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,653 copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,655 copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,657 copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,659 copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,660 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,662 copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,664 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,666 copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,667 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,669 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,670 copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,672 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,674 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,675 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,677 copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,678 copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,680 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,682 copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,683 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,685 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,687 copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,689 copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,690 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,692 copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,694 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,695 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,697 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,699 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,700 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,702 copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,704 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,705 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,707 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,709 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,711 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,712 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,714 copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,715 copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,717 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,718 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,720 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,722 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,723 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,725 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,726 copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,728 copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,730 copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,732 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,734 copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,735 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,737 copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,739 copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,740 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,742 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,744 copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,745 copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,747 copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2025-11-27T00:44:01,749 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa 2025-11-27T00:44:01,750 copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2025-11-27T00:44:01,752 copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2025-11-27T00:44:01,754 copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2025-11-27T00:44:01,756 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt 2025-11-27T00:44:01,757 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,759 copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,761 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,762 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,764 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,765 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,767 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,769 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,770 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,772 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,774 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,775 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,777 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2025-11-27T00:44:01,780 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval 2025-11-27T00:44:01,781 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,783 copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,784 copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,787 copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,788 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,790 copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,792 copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,794 copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,795 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,797 copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,799 copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,801 copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,803 copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,804 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,806 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,808 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,809 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,811 copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,813 copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,814 copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,816 copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,817 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,819 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,821 copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,823 copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,824 copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,826 copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,828 copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,830 copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,831 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,833 copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,835 copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,837 copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,838 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,840 copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,842 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,843 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,845 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,847 copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,849 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,851 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,852 copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,854 copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,856 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,857 copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,859 copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,861 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,862 copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,864 copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,866 copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,867 copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,869 copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,871 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,873 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,874 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,876 copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2025-11-27T00:44:01,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egyhellaswag 2025-11-27T00:44:01,879 copying build/lib/lm_eval/tasks/egyhellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2025-11-27T00:44:01,881 copying build/lib/lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2025-11-27T00:44:01,883 copying build/lib/lm_eval/tasks/egyhellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2025-11-27T00:44:01,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu 2025-11-27T00:44:01,886 copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2025-11-27T00:44:01,889 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,890 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,892 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,894 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,896 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,897 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,899 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,901 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,902 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,904 copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,906 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,907 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,909 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,911 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,912 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,914 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,916 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,918 copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,920 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,921 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,923 copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,925 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,927 copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,929 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,931 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,932 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,934 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,936 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,937 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,940 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,941 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,943 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,945 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,946 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,948 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,950 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2025-11-27T00:44:01,951 copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2025-11-27T00:44:01,954 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld 2025-11-27T00:44:01,955 copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2025-11-27T00:44:01,956 copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2025-11-27T00:44:01,958 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2025-11-27T00:44:01,960 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2025-11-27T00:44:01,962 copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2025-11-27T00:44:01,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,965 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,967 copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,969 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,971 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,972 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,974 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,976 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,978 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,979 copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,982 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,983 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2025-11-27T00:44:01,986 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia 2025-11-27T00:44:01,987 copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2025-11-27T00:44:01,989 copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2025-11-27T00:44:01,991 copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2025-11-27T00:44:01,993 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa 2025-11-27T00:44:01,994 copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2025-11-27T00:44:01,996 copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2025-11-27T00:44:01,998 copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2025-11-27T00:44:02,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/common_voice 2025-11-27T00:44:02,001 copying build/lib/lm_eval/tasks/common_voice/common_voice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2025-11-27T00:44:02,003 copying build/lib/lm_eval/tasks/common_voice/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2025-11-27T00:44:02,005 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race 2025-11-27T00:44:02,006 copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2025-11-27T00:44:02,008 copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2025-11-27T00:44:02,010 copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2025-11-27T00:44:02,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,013 copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,015 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,017 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,019 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,020 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,022 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2025-11-27T00:44:02,025 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijahellaswag 2025-11-27T00:44:02,026 copying build/lib/lm_eval/tasks/darijahellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2025-11-27T00:44:02,028 copying build/lib/lm_eval/tasks/darijahellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2025-11-27T00:44:02,029 copying build/lib/lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2025-11-27T00:44:02,032 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa 2025-11-27T00:44:02,033 copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2025-11-27T00:44:02,035 copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2025-11-27T00:44:02,037 copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2025-11-27T00:44:02,039 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus 2025-11-27T00:44:02,040 copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2025-11-27T00:44:02,042 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2025-11-27T00:44:02,044 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2025-11-27T00:44:02,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa 2025-11-27T00:44:02,048 copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,050 copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,051 copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,053 copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,055 copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,056 copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,058 copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,060 copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,061 copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,063 copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,065 copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,066 copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,068 copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,070 copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2025-11-27T00:44:02,072 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa 2025-11-27T00:44:02,073 copying build/lib/lm_eval/tasks/global_piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2025-11-27T00:44:02,077 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,079 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,080 copying build/lib/lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,082 copying build/lib/lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,084 copying build/lib/lm_eval/tasks/global_piqa/prompted/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,086 copying build/lib/lm_eval/tasks/global_piqa/prompted/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,087 copying build/lib/lm_eval/tasks/global_piqa/prompted/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,089 copying build/lib/lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,091 copying build/lib/lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,093 copying build/lib/lm_eval/tasks/global_piqa/prompted/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,094 copying build/lib/lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,096 copying build/lib/lm_eval/tasks/global_piqa/prompted/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,098 copying build/lib/lm_eval/tasks/global_piqa/prompted/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,100 copying build/lib/lm_eval/tasks/global_piqa/prompted/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,101 copying build/lib/lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,103 copying build/lib/lm_eval/tasks/global_piqa/prompted/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,104 copying build/lib/lm_eval/tasks/global_piqa/prompted/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,106 copying build/lib/lm_eval/tasks/global_piqa/prompted/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,108 copying build/lib/lm_eval/tasks/global_piqa/prompted/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,109 copying build/lib/lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,111 copying build/lib/lm_eval/tasks/global_piqa/prompted/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,113 copying build/lib/lm_eval/tasks/global_piqa/prompted/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,114 copying build/lib/lm_eval/tasks/global_piqa/prompted/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,116 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,118 copying build/lib/lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,119 copying build/lib/lm_eval/tasks/global_piqa/prompted/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,121 copying build/lib/lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,123 copying build/lib/lm_eval/tasks/global_piqa/prompted/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,125 copying build/lib/lm_eval/tasks/global_piqa/prompted/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,126 copying build/lib/lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,128 copying build/lib/lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,130 copying build/lib/lm_eval/tasks/global_piqa/prompted/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,132 copying build/lib/lm_eval/tasks/global_piqa/prompted/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,133 copying build/lib/lm_eval/tasks/global_piqa/prompted/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,135 copying build/lib/lm_eval/tasks/global_piqa/prompted/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,137 copying build/lib/lm_eval/tasks/global_piqa/prompted/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,139 copying build/lib/lm_eval/tasks/global_piqa/prompted/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,140 copying build/lib/lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,142 copying build/lib/lm_eval/tasks/global_piqa/prompted/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,144 copying build/lib/lm_eval/tasks/global_piqa/prompted/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,145 copying build/lib/lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,147 copying build/lib/lm_eval/tasks/global_piqa/prompted/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,148 copying build/lib/lm_eval/tasks/global_piqa/prompted/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,150 copying build/lib/lm_eval/tasks/global_piqa/prompted/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,152 copying build/lib/lm_eval/tasks/global_piqa/prompted/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,154 copying build/lib/lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,155 copying build/lib/lm_eval/tasks/global_piqa/prompted/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,157 copying build/lib/lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,159 copying build/lib/lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,160 copying build/lib/lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,162 copying build/lib/lm_eval/tasks/global_piqa/prompted/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,164 copying build/lib/lm_eval/tasks/global_piqa/prompted/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,166 copying build/lib/lm_eval/tasks/global_piqa/prompted/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,167 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,169 copying build/lib/lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,171 copying build/lib/lm_eval/tasks/global_piqa/prompted/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,172 copying build/lib/lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,174 copying build/lib/lm_eval/tasks/global_piqa/prompted/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,176 copying build/lib/lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,177 copying build/lib/lm_eval/tasks/global_piqa/prompted/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,179 copying build/lib/lm_eval/tasks/global_piqa/prompted/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,181 copying build/lib/lm_eval/tasks/global_piqa/prompted/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,183 copying build/lib/lm_eval/tasks/global_piqa/prompted/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,184 copying build/lib/lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,186 copying build/lib/lm_eval/tasks/global_piqa/prompted/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,188 copying build/lib/lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,189 copying build/lib/lm_eval/tasks/global_piqa/prompted/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,191 copying build/lib/lm_eval/tasks/global_piqa/prompted/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,193 copying build/lib/lm_eval/tasks/global_piqa/prompted/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,194 copying build/lib/lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,197 copying build/lib/lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,199 copying build/lib/lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,200 copying build/lib/lm_eval/tasks/global_piqa/prompted/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,202 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,204 copying build/lib/lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,205 copying build/lib/lm_eval/tasks/global_piqa/prompted/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,207 copying build/lib/lm_eval/tasks/global_piqa/prompted/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,209 copying build/lib/lm_eval/tasks/global_piqa/prompted/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,211 copying build/lib/lm_eval/tasks/global_piqa/prompted/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,212 copying build/lib/lm_eval/tasks/global_piqa/prompted/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,214 copying build/lib/lm_eval/tasks/global_piqa/prompted/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,216 copying build/lib/lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,217 copying build/lib/lm_eval/tasks/global_piqa/prompted/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,219 copying build/lib/lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,221 copying build/lib/lm_eval/tasks/global_piqa/prompted/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,223 copying build/lib/lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,224 copying build/lib/lm_eval/tasks/global_piqa/prompted/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,226 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,228 copying build/lib/lm_eval/tasks/global_piqa/prompted/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,230 copying build/lib/lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,231 copying build/lib/lm_eval/tasks/global_piqa/prompted/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,233 copying build/lib/lm_eval/tasks/global_piqa/prompted/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,234 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,236 copying build/lib/lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,238 copying build/lib/lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,240 copying build/lib/lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,241 copying build/lib/lm_eval/tasks/global_piqa/prompted/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,243 copying build/lib/lm_eval/tasks/global_piqa/prompted/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,245 copying build/lib/lm_eval/tasks/global_piqa/prompted/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,246 copying build/lib/lm_eval/tasks/global_piqa/prompted/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,248 copying build/lib/lm_eval/tasks/global_piqa/prompted/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,250 copying build/lib/lm_eval/tasks/global_piqa/prompted/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,252 copying build/lib/lm_eval/tasks/global_piqa/prompted/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,253 copying build/lib/lm_eval/tasks/global_piqa/prompted/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,255 copying build/lib/lm_eval/tasks/global_piqa/prompted/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,257 copying build/lib/lm_eval/tasks/global_piqa/prompted/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,259 copying build/lib/lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,260 copying build/lib/lm_eval/tasks/global_piqa/prompted/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,262 copying build/lib/lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,264 copying build/lib/lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,265 copying build/lib/lm_eval/tasks/global_piqa/prompted/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,267 copying build/lib/lm_eval/tasks/global_piqa/prompted/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,269 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,271 copying build/lib/lm_eval/tasks/global_piqa/prompted/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,272 copying build/lib/lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,274 copying build/lib/lm_eval/tasks/global_piqa/prompted/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,275 copying build/lib/lm_eval/tasks/global_piqa/prompted/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,277 copying build/lib/lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,279 copying build/lib/lm_eval/tasks/global_piqa/prompted/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,281 copying build/lib/lm_eval/tasks/global_piqa/prompted/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2025-11-27T00:44:02,284 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,286 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,287 copying build/lib/lm_eval/tasks/global_piqa/completions/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,289 copying build/lib/lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,291 copying build/lib/lm_eval/tasks/global_piqa/completions/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,293 copying build/lib/lm_eval/tasks/global_piqa/completions/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,295 copying build/lib/lm_eval/tasks/global_piqa/completions/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,296 copying build/lib/lm_eval/tasks/global_piqa/completions/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,298 copying build/lib/lm_eval/tasks/global_piqa/completions/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,300 copying build/lib/lm_eval/tasks/global_piqa/completions/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,301 copying build/lib/lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,303 copying build/lib/lm_eval/tasks/global_piqa/completions/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,305 copying build/lib/lm_eval/tasks/global_piqa/completions/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,307 copying build/lib/lm_eval/tasks/global_piqa/completions/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,308 copying build/lib/lm_eval/tasks/global_piqa/completions/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,310 copying build/lib/lm_eval/tasks/global_piqa/completions/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,312 copying build/lib/lm_eval/tasks/global_piqa/completions/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,313 copying build/lib/lm_eval/tasks/global_piqa/completions/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,315 copying build/lib/lm_eval/tasks/global_piqa/completions/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,317 copying build/lib/lm_eval/tasks/global_piqa/completions/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,319 copying build/lib/lm_eval/tasks/global_piqa/completions/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,320 copying build/lib/lm_eval/tasks/global_piqa/completions/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,322 copying build/lib/lm_eval/tasks/global_piqa/completions/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,324 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,325 copying build/lib/lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,327 copying build/lib/lm_eval/tasks/global_piqa/completions/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,329 copying build/lib/lm_eval/tasks/global_piqa/completions/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,330 copying build/lib/lm_eval/tasks/global_piqa/completions/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,332 copying build/lib/lm_eval/tasks/global_piqa/completions/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,334 copying build/lib/lm_eval/tasks/global_piqa/completions/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,336 copying build/lib/lm_eval/tasks/global_piqa/completions/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,337 copying build/lib/lm_eval/tasks/global_piqa/completions/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,339 copying build/lib/lm_eval/tasks/global_piqa/completions/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,341 copying build/lib/lm_eval/tasks/global_piqa/completions/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,343 copying build/lib/lm_eval/tasks/global_piqa/completions/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,344 copying build/lib/lm_eval/tasks/global_piqa/completions/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,346 copying build/lib/lm_eval/tasks/global_piqa/completions/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,348 copying build/lib/lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,350 copying build/lib/lm_eval/tasks/global_piqa/completions/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,351 copying build/lib/lm_eval/tasks/global_piqa/completions/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,353 copying build/lib/lm_eval/tasks/global_piqa/completions/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,355 copying build/lib/lm_eval/tasks/global_piqa/completions/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,356 copying build/lib/lm_eval/tasks/global_piqa/completions/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,358 copying build/lib/lm_eval/tasks/global_piqa/completions/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,360 copying build/lib/lm_eval/tasks/global_piqa/completions/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,361 copying build/lib/lm_eval/tasks/global_piqa/completions/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,363 copying build/lib/lm_eval/tasks/global_piqa/completions/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,365 copying build/lib/lm_eval/tasks/global_piqa/completions/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,366 copying build/lib/lm_eval/tasks/global_piqa/completions/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,368 copying build/lib/lm_eval/tasks/global_piqa/completions/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,370 copying build/lib/lm_eval/tasks/global_piqa/completions/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,372 copying build/lib/lm_eval/tasks/global_piqa/completions/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,374 copying build/lib/lm_eval/tasks/global_piqa/completions/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,375 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,377 copying build/lib/lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,379 copying build/lib/lm_eval/tasks/global_piqa/completions/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,381 copying build/lib/lm_eval/tasks/global_piqa/completions/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,382 copying build/lib/lm_eval/tasks/global_piqa/completions/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,384 copying build/lib/lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,386 copying build/lib/lm_eval/tasks/global_piqa/completions/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,387 copying build/lib/lm_eval/tasks/global_piqa/completions/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,389 copying build/lib/lm_eval/tasks/global_piqa/completions/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,391 copying build/lib/lm_eval/tasks/global_piqa/completions/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,393 copying build/lib/lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,395 copying build/lib/lm_eval/tasks/global_piqa/completions/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,396 copying build/lib/lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,398 copying build/lib/lm_eval/tasks/global_piqa/completions/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,400 copying build/lib/lm_eval/tasks/global_piqa/completions/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,401 copying build/lib/lm_eval/tasks/global_piqa/completions/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,403 copying build/lib/lm_eval/tasks/global_piqa/completions/_global_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,405 copying build/lib/lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,407 copying build/lib/lm_eval/tasks/global_piqa/completions/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,408 copying build/lib/lm_eval/tasks/global_piqa/completions/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,410 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,412 copying build/lib/lm_eval/tasks/global_piqa/completions/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,413 copying build/lib/lm_eval/tasks/global_piqa/completions/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,415 copying build/lib/lm_eval/tasks/global_piqa/completions/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,417 copying build/lib/lm_eval/tasks/global_piqa/completions/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,419 copying build/lib/lm_eval/tasks/global_piqa/completions/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,421 copying build/lib/lm_eval/tasks/global_piqa/completions/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,422 copying build/lib/lm_eval/tasks/global_piqa/completions/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,424 copying build/lib/lm_eval/tasks/global_piqa/completions/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,426 copying build/lib/lm_eval/tasks/global_piqa/completions/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,427 copying build/lib/lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,429 copying build/lib/lm_eval/tasks/global_piqa/completions/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,431 copying build/lib/lm_eval/tasks/global_piqa/completions/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,433 copying build/lib/lm_eval/tasks/global_piqa/completions/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,434 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,436 copying build/lib/lm_eval/tasks/global_piqa/completions/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,438 copying build/lib/lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,440 copying build/lib/lm_eval/tasks/global_piqa/completions/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,441 copying build/lib/lm_eval/tasks/global_piqa/completions/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,443 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,444 copying build/lib/lm_eval/tasks/global_piqa/completions/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,446 copying build/lib/lm_eval/tasks/global_piqa/completions/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,448 copying build/lib/lm_eval/tasks/global_piqa/completions/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,449 copying build/lib/lm_eval/tasks/global_piqa/completions/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,451 copying build/lib/lm_eval/tasks/global_piqa/completions/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,453 copying build/lib/lm_eval/tasks/global_piqa/completions/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,454 copying build/lib/lm_eval/tasks/global_piqa/completions/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,456 copying build/lib/lm_eval/tasks/global_piqa/completions/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,458 copying build/lib/lm_eval/tasks/global_piqa/completions/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,460 copying build/lib/lm_eval/tasks/global_piqa/completions/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,461 copying build/lib/lm_eval/tasks/global_piqa/completions/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,463 copying build/lib/lm_eval/tasks/global_piqa/completions/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,465 copying build/lib/lm_eval/tasks/global_piqa/completions/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,467 copying build/lib/lm_eval/tasks/global_piqa/completions/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,469 copying build/lib/lm_eval/tasks/global_piqa/completions/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,470 copying build/lib/lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,472 copying build/lib/lm_eval/tasks/global_piqa/completions/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,474 copying build/lib/lm_eval/tasks/global_piqa/completions/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,476 copying build/lib/lm_eval/tasks/global_piqa/completions/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,477 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,479 copying build/lib/lm_eval/tasks/global_piqa/completions/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,481 copying build/lib/lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,483 copying build/lib/lm_eval/tasks/global_piqa/completions/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,484 copying build/lib/lm_eval/tasks/global_piqa/completions/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,486 copying build/lib/lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,488 copying build/lib/lm_eval/tasks/global_piqa/completions/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,489 copying build/lib/lm_eval/tasks/global_piqa/completions/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2025-11-27T00:44:02,492 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli 2025-11-27T00:44:02,493 copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2025-11-27T00:44:02,495 copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2025-11-27T00:44:02,496 copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2025-11-27T00:44:02,498 copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2025-11-27T00:44:02,500 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad 2025-11-27T00:44:02,502 copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,503 copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,505 copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,507 copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,509 copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,511 copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,512 copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,514 copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,516 copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,517 copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,519 copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,521 copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,523 copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,524 copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,526 copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2025-11-27T00:44:02,529 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench 2025-11-27T00:44:02,530 copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2025-11-27T00:44:02,532 copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2025-11-27T00:44:02,533 copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2025-11-27T00:44:02,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:44:02,537 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:44:02,538 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:44:02,540 copying build/lib/lm_eval/tasks/eq_bench/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2025-11-27T00:44:02,543 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa 2025-11-27T00:44:02,543 copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,545 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,547 copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,549 copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,550 copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,552 copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,554 copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,556 copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,558 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,559 copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2025-11-27T00:44:02,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bangla 2025-11-27T00:44:02,562 copying build/lib/lm_eval/tasks/bangla/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2025-11-27T00:44:02,564 copying build/lib/lm_eval/tasks/bangla/bangla_mmlu_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2025-11-27T00:44:02,567 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math 2025-11-27T00:44:02,568 copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,570 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,571 copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,574 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,575 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,577 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,579 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,581 copying build/lib/lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,583 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,585 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2025-11-27T00:44:02,587 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k 2025-11-27T00:44:02,588 copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2025-11-27T00:44:02,589 copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2025-11-27T00:44:02,592 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde 2025-11-27T00:44:02,593 copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2025-11-27T00:44:02,595 copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2025-11-27T00:44:02,597 copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2025-11-27T00:44:02,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k 2025-11-27T00:44:02,600 copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,602 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,604 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,606 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,608 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,610 copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2025-11-27T00:44:02,612 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meqsum 2025-11-27T00:44:02,613 copying build/lib/lm_eval/tasks/meqsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2025-11-27T00:44:02,615 copying build/lib/lm_eval/tasks/meqsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2025-11-27T00:44:02,617 copying build/lib/lm_eval/tasks/meqsum/meqsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2025-11-27T00:44:02,620 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,621 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,622 copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,624 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,626 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,628 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,630 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,631 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,633 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,635 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,637 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,638 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,640 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,642 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,643 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,645 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,647 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,648 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,650 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,652 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,654 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,655 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,657 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,659 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,661 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,662 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,664 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,666 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,667 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,669 copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,671 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,673 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,674 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,676 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,678 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,680 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,682 copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,684 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,685 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,687 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,689 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,691 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,692 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,694 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,696 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,698 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,699 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,701 copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,703 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,705 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,706 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2025-11-27T00:44:02,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/chartqa 2025-11-27T00:44:02,710 copying build/lib/lm_eval/tasks/chartqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2025-11-27T00:44:02,712 copying build/lib/lm_eval/tasks/chartqa/chartqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2025-11-27T00:44:02,714 copying build/lib/lm_eval/tasks/chartqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2025-11-27T00:44:02,716 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2025-11-27T00:44:02,718 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2025-11-27T00:44:02,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,723 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,725 copying build/lib/lm_eval/tasks/zhoblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,727 copying build/lib/lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,729 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,730 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,732 copying build/lib/lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,733 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,735 copying build/lib/lm_eval/tasks/zhoblimp/left_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,737 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,738 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,740 copying build/lib/lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,742 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,743 copying build/lib/lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,745 copying build/lib/lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,747 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,749 copying build/lib/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,751 copying build/lib/lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,752 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,754 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,756 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,757 copying build/lib/lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,759 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,761 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,762 copying build/lib/lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,764 copying build/lib/lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,766 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,768 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,769 copying build/lib/lm_eval/tasks/zhoblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,771 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,773 copying build/lib/lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,775 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,776 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,778 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,780 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,781 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,783 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,784 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,786 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,788 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,790 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,792 copying build/lib/lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,793 copying build/lib/lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,795 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,797 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,798 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,800 copying build/lib/lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,802 copying build/lib/lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,803 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,805 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,807 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,809 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,810 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,812 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,814 copying build/lib/lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,816 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,818 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,819 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,821 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,823 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,824 copying build/lib/lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,826 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,828 copying build/lib/lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,829 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,831 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,833 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,835 copying build/lib/lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,836 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,838 copying build/lib/lm_eval/tasks/zhoblimp/you_yige.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,840 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,841 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,843 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,845 copying build/lib/lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,846 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,848 copying build/lib/lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,850 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,852 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,853 copying build/lib/lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,855 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,857 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,859 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,860 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,862 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,864 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,866 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,867 copying build/lib/lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,869 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,871 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,873 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,874 copying build/lib/lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,876 copying build/lib/lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,878 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,879 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,881 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,883 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,884 copying build/lib/lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,886 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,888 copying build/lib/lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,890 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,891 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,893 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,895 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,896 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,898 copying build/lib/lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,900 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,902 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,904 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,907 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,909 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,911 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,912 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,914 copying build/lib/lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,916 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,917 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,919 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,921 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,923 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,924 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,926 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,928 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,930 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,931 copying build/lib/lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2025-11-27T00:44:02,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/moral_stories 2025-11-27T00:44:02,935 copying build/lib/lm_eval/tasks/moral_stories/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2025-11-27T00:44:02,937 copying build/lib/lm_eval/tasks/moral_stories/moral_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2025-11-27T00:44:02,939 copying build/lib/lm_eval/tasks/moral_stories/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2025-11-27T00:44:02,941 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3 2025-11-27T00:44:02,942 copying build/lib/lm_eval/tasks/llama3/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3 2025-11-27T00:44:02,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct 2025-11-27T00:44:02,947 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,949 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,951 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,952 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,954 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,956 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,958 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,960 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,962 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,964 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,966 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,968 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,970 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,972 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,974 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,976 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,978 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,981 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,983 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,984 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,986 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,988 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,990 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,992 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,994 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,996 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:02,998 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,000 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,002 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,004 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,006 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,008 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,010 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,012 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,014 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,015 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,017 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,020 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,021 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,024 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,026 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,028 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,030 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,032 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,034 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,035 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,037 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,039 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,041 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,043 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,045 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,047 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,049 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,051 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,052 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,054 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,056 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,058 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,059 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,061 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,063 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,065 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,067 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,069 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,071 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2025-11-27T00:44:03,073 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,074 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,076 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,079 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,080 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,082 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,084 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,086 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,087 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,089 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,091 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,093 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,095 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,096 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,098 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,100 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,102 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,103 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2025-11-27T00:44:03,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,107 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,110 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,113 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,115 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,117 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,120 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,123 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,125 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,128 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,130 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,133 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,135 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,137 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,140 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,142 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,144 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,146 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,148 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,150 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,153 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,155 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,158 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,160 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,163 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,165 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,168 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,170 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,172 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,175 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,177 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,179 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,181 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,184 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,186 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,188 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,191 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,193 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,196 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,197 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,199 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,202 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,204 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,206 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,208 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,210 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,213 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,215 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,217 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,219 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,221 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,223 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,226 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,229 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,231 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,233 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,235 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,238 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,240 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,242 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,244 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,246 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,248 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,251 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,253 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2025-11-27T00:44:03,257 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,259 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,260 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,262 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,264 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,266 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,268 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,270 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,272 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,274 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,276 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,278 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,280 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,282 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,283 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,286 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,288 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,290 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,292 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,293 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,295 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,297 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,299 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,301 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,303 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,305 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,307 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,309 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,311 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,313 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,315 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,317 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,319 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,320 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,322 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,324 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,326 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,328 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,330 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,333 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,335 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,337 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,340 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,342 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,344 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,346 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,349 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,352 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,354 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,356 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,358 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,361 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,363 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,365 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,368 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,371 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,373 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,376 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,378 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,381 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,383 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,386 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,388 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,390 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,393 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2025-11-27T00:44:03,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,398 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,401 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,403 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,406 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,408 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,411 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,413 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,415 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,418 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,420 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,422 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,425 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,427 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,429 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,431 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,433 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,435 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,437 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,439 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,441 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,442 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,445 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,446 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,448 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,450 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,452 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,454 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,455 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,457 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,459 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,461 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,463 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,465 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,467 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,469 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,471 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,473 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,475 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,477 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,480 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,481 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,483 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,485 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,487 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,489 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,490 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,492 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,494 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,496 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,498 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,500 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,502 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,504 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,506 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,508 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,510 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,511 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,514 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,516 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,518 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,520 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,522 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,524 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,526 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2025-11-27T00:44:03,529 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,530 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,532 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,534 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,535 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,537 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,539 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,541 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,542 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,544 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,546 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,548 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,550 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,552 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,553 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,555 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,557 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,559 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,561 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,563 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,565 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,567 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,568 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,570 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,572 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,574 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,576 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,578 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,579 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,581 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,583 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,585 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,586 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,588 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,590 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,592 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,594 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,595 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,597 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,599 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,601 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,603 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,605 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,607 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,609 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,610 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,612 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,614 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,616 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,617 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,619 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,621 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,623 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,624 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,626 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,628 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,630 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,632 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,633 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,635 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,637 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,639 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,640 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,642 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2025-11-27T00:44:03,645 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,647 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,649 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,650 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,652 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,654 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,656 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,657 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,659 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,661 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,663 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,664 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,666 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,668 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,670 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,671 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,673 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,675 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,676 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,678 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,680 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,682 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,684 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,686 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,687 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,689 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,691 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,693 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,694 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,696 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,698 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,701 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,706 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,708 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,710 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,712 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,714 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,716 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,717 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,719 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,721 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,723 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,725 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,727 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,729 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,730 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,732 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,734 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,736 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,738 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,745 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,746 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,749 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,750 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,752 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,754 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,758 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2025-11-27T00:44:03,760 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:44:03,761 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:44:03,763 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2025-11-27T00:44:03,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,768 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,770 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,773 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,775 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,777 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,780 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,784 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,786 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,788 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,791 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,793 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,796 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,798 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,801 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,803 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,805 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,808 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,810 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,811 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,813 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,815 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,818 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,820 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,823 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,825 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,827 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,829 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,831 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,834 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,836 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,838 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,840 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,842 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,845 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,847 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,849 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,852 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,854 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,859 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,861 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,864 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,866 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,869 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,872 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,874 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,877 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,879 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,882 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,884 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,886 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,889 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,891 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,893 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,895 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,900 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,902 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,905 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,907 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,909 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,912 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,915 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2025-11-27T00:44:03,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,920 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,922 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,924 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,926 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,928 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,931 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,932 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,934 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,936 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,939 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,941 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,943 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,945 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,947 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,949 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,951 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,952 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,954 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,956 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,959 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,961 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,964 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,966 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,969 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,971 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,973 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,975 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,977 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,979 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,981 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,983 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,985 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,987 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,989 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,991 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,993 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,995 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,997 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:03,999 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,002 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,004 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,007 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,009 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,012 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,014 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,016 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,017 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,020 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,022 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,024 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,025 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,027 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,029 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,031 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,033 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,035 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,037 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,039 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,041 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,043 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,046 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,048 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,051 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,053 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2025-11-27T00:44:04,056 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/gsm8k 2025-11-27T00:44:04,058 copying build/lib/lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/gsm8k 2025-11-27T00:44:04,061 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,062 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,065 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,067 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,069 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,071 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,073 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,076 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,078 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,080 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,082 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,084 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,086 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,088 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,090 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,092 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,094 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,096 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,098 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,100 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,102 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,104 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,106 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,108 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,110 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,112 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,114 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,116 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,118 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,120 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,122 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,124 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,125 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,127 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,130 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,132 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,134 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,136 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,138 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,140 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,141 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,143 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,146 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,148 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,150 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,152 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,154 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,156 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,158 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,161 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,163 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,164 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,166 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,168 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,170 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,172 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,174 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,176 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,178 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,180 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,182 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,184 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,186 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,188 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,190 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2025-11-27T00:44:04,193 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest 2025-11-27T00:44:04,194 copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,196 copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,198 copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,200 copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,202 copying build/lib/lm_eval/tasks/kobest/_kobest.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,204 copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,206 copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,208 copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2025-11-27T00:44:04,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex 2025-11-27T00:44:04,211 copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2025-11-27T00:44:04,213 copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2025-11-27T00:44:04,215 copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2025-11-27T00:44:04,217 copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2025-11-27T00:44:04,218 copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2025-11-27T00:44:04,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi 2025-11-27T00:44:04,222 copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2025-11-27T00:44:04,224 copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2025-11-27T00:44:04,227 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mlqa 2025-11-27T00:44:04,228 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,230 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,232 copying build/lib/lm_eval/tasks/mlqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,234 copying build/lib/lm_eval/tasks/mlqa/mlqa_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,236 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,238 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,240 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,242 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,244 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,246 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,248 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,250 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,251 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,253 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,255 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,257 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,259 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,261 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,263 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,265 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,267 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,268 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,270 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,272 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,274 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,275 copying build/lib/lm_eval/tasks/mlqa/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,277 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,279 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,281 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,283 copying build/lib/lm_eval/tasks/mlqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,286 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,288 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,290 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,291 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,293 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,295 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,297 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,299 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,301 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,303 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,305 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,307 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,308 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,310 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,312 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,314 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,316 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,318 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,320 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,322 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,323 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,325 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,327 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2025-11-27T00:44:04,329 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench 2025-11-27T00:44:04,330 copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,332 copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,335 copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,337 copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,338 copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,341 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,342 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,344 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,346 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,348 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,350 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,352 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,354 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,356 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,358 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,360 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,362 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,364 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,366 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,368 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,370 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,372 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,374 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,376 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,378 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2025-11-27T00:44:04,380 copying build/lib/lm_eval/tasks/basque_bench/paws_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,382 copying build/lib/lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,384 copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,386 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,387 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,389 copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2025-11-27T00:44:04,392 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,393 copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,396 copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,398 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,400 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,401 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,403 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,405 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,407 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,409 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,411 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,413 copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,415 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,417 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,419 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2025-11-27T00:44:04,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,422 copying build/lib/lm_eval/tasks/mediqa_qa2019/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,424 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,426 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,428 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,430 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2025-11-27T00:44:04,434 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu 2025-11-27T00:44:04,435 copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,437 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,440 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,442 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,444 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,445 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,447 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,449 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,451 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,453 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,455 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,457 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,459 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,461 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,462 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,464 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,466 copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,468 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,470 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,472 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,474 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,476 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,478 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,480 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,482 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,483 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,485 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,487 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,488 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,490 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,492 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,494 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,496 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,498 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,500 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,502 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,503 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,505 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,507 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,509 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,511 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,513 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,515 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,516 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,519 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,521 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,523 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,525 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,526 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,528 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,530 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,532 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,534 copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,536 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,537 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,539 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,541 copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,543 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,545 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,547 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,549 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,551 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,553 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,554 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,556 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,558 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,560 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,562 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,564 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,566 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,567 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2025-11-27T00:44:04,570 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,571 copying build/lib/lm_eval/tasks/truthfulqa-multi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,573 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,575 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,577 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,579 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,581 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,583 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,585 copying build/lib/lm_eval/tasks/truthfulqa-multi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,587 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,589 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,590 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,592 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,594 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,596 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,597 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,599 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,601 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,603 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,605 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2025-11-27T00:44:04,607 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench2 2025-11-27T00:44:04,609 copying build/lib/lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,611 copying build/lib/lm_eval/tasks/longbench2/longbench2_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,613 copying build/lib/lm_eval/tasks/longbench2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,615 copying build/lib/lm_eval/tasks/longbench2/_longbench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,617 copying build/lib/lm_eval/tasks/longbench2/many_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,619 copying build/lib/lm_eval/tasks/longbench2/news_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,620 copying build/lib/lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,622 copying build/lib/lm_eval/tasks/longbench2/user_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,624 copying build/lib/lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,626 copying build/lib/lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,628 copying build/lib/lm_eval/tasks/longbench2/legal_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,630 copying build/lib/lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,632 copying build/lib/lm_eval/tasks/longbench2/graph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,634 copying build/lib/lm_eval/tasks/longbench2/academic_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,636 copying build/lib/lm_eval/tasks/longbench2/translate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,638 copying build/lib/lm_eval/tasks/longbench2/event_order.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,640 copying build/lib/lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,642 copying build/lib/lm_eval/tasks/longbench2/_longbench2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,644 copying build/lib/lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,646 copying build/lib/lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,647 copying build/lib/lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,649 copying build/lib/lm_eval/tasks/longbench2/table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,651 copying build/lib/lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,653 copying build/lib/lm_eval/tasks/longbench2/detective.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,655 copying build/lib/lm_eval/tasks/longbench2/dialogue_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,657 copying build/lib/lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,658 copying build/lib/lm_eval/tasks/longbench2/legal_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,660 copying build/lib/lm_eval/tasks/longbench2/agent_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2025-11-27T00:44:04,663 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada 2025-11-27T00:44:04,664 copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2025-11-27T00:44:04,666 copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2025-11-27T00:44:04,668 copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2025-11-27T00:44:04,670 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbq 2025-11-27T00:44:04,671 copying build/lib/lm_eval/tasks/bbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,674 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,675 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,677 copying build/lib/lm_eval/tasks/bbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,680 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,682 copying build/lib/lm_eval/tasks/bbq/bbq_generate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,684 copying build/lib/lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,686 copying build/lib/lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2025-11-27T00:44:04,689 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench 2025-11-27T00:44:04,690 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,692 copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,695 copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,697 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,699 copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,700 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,702 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,704 copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,706 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,708 copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,710 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,712 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,714 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,716 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,718 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,720 copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,722 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,724 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,726 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,728 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,730 copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,732 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,734 copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,736 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,738 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,740 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,742 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,744 copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,745 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2025-11-27T00:44:04,748 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi 2025-11-27T00:44:04,750 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,751 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,753 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,755 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,757 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,759 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,760 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,762 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,764 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,766 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,768 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,770 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,772 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,774 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,776 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,778 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,779 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,781 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,783 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,785 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,787 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,789 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,790 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,792 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,794 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,796 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,798 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,799 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,801 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,803 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,805 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,807 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,809 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,811 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2025-11-27T00:44:04,814 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,815 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,817 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,819 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,822 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,824 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,825 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,827 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,829 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,831 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,833 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,835 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,837 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,839 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,840 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,842 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,844 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,846 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,848 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,849 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,851 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,853 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,855 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,857 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,859 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,860 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,862 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,864 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,866 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,868 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,870 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,871 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,873 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,875 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,877 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2025-11-27T00:44:04,880 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,881 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,883 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,884 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,886 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,888 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,890 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,891 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,893 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,895 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,896 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,898 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,900 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,902 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,903 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,905 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,907 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,908 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,910 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,912 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,913 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,915 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,917 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,919 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,920 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,922 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,924 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,926 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,927 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,929 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,931 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,932 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,934 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,936 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,937 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,939 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,941 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,942 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,944 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,946 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,948 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,949 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,951 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,953 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,955 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,957 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,959 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,961 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,963 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,964 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,966 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,968 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,970 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,972 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,973 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,975 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,977 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,979 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,981 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,982 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,984 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,986 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,988 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,990 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,992 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,994 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,996 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2025-11-27T00:44:04,999 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,000 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,002 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,004 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,006 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,007 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,009 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,011 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,013 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,014 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,016 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,018 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,020 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,022 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,024 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,026 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,028 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,030 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,032 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,033 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,035 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,037 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,039 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,041 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,043 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,045 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,046 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,048 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,050 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,052 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,054 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,056 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,058 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,060 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,062 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,064 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,066 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2025-11-27T00:44:05,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,071 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,073 copying build/lib/lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,075 copying build/lib/lm_eval/tasks/blimp_nl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,077 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,079 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,081 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,083 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,085 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,087 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,089 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,090 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,092 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,094 copying build/lib/lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,096 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,098 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,100 copying build/lib/lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,102 copying build/lib/lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,104 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,106 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,108 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,110 copying build/lib/lm_eval/tasks/blimp_nl/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,111 copying build/lib/lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,114 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,116 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,118 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,120 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,122 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,124 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,126 copying build/lib/lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,127 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,130 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,132 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,134 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,135 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,137 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,139 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,141 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,143 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,145 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,147 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,149 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,150 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,152 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,154 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,156 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,158 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,160 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,162 copying build/lib/lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,164 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,166 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,168 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,170 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,172 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,174 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,176 copying build/lib/lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,178 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,180 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,182 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,184 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,186 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,188 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,190 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,191 copying build/lib/lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,193 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,195 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,197 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,200 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,202 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,205 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,209 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,211 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,213 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,215 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,217 copying build/lib/lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,219 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,221 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,223 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,225 copying build/lib/lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,227 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,229 copying build/lib/lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,231 copying build/lib/lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,232 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,234 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,236 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,238 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,240 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,242 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2025-11-27T00:44:05,247 copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2025-11-27T00:44:05,251 copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2025-11-27T00:44:05,255 creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination 2025-11-27T00:44:05,256 copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2025-11-27T00:44:05,259 copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2025-11-27T00:44:05,260 copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2025-11-27T00:44:05,263 copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2025-11-27T00:44:05,269 running install_egg_info 2025-11-27T00:44:05,276 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.9.2-py3.11.egg-info 2025-11-27T00:44:05,311 running install_scripts 2025-11-27T00:44:05,325 creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.9.2.dist-info/WHEEL 2025-11-27T00:44:05,328 creating '/tmp/pip-wheel-_js5usf1/.tmp-c59z33e9/lm_eval-0.4.9.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-11-27T00:44:05,330 adding 'lm_eval/__init__.py' 2025-11-27T00:44:05,333 adding 'lm_eval/__main__.py' 2025-11-27T00:44:05,337 adding 'lm_eval/evaluator.py' 2025-11-27T00:44:05,341 adding 'lm_eval/evaluator_utils.py' 2025-11-27T00:44:05,344 adding 'lm_eval/utils.py' 2025-11-27T00:44:05,346 adding 'lm_eval/api/__init__.py' 2025-11-27T00:44:05,348 adding 'lm_eval/api/filter.py' 2025-11-27T00:44:05,349 adding 'lm_eval/api/group.py' 2025-11-27T00:44:05,350 adding 'lm_eval/api/instance.py' 2025-11-27T00:44:05,353 adding 'lm_eval/api/metrics.py' 2025-11-27T00:44:05,356 adding 'lm_eval/api/model.py' 2025-11-27T00:44:05,358 adding 'lm_eval/api/registry.py' 2025-11-27T00:44:05,360 adding 'lm_eval/api/samplers.py' 2025-11-27T00:44:05,368 adding 'lm_eval/api/task.py' 2025-11-27T00:44:05,370 adding 'lm_eval/caching/__init__.py' 2025-11-27T00:44:05,371 adding 'lm_eval/caching/cache.py' 2025-11-27T00:44:05,373 adding 'lm_eval/decontamination/__init__.py' 2025-11-27T00:44:05,375 adding 'lm_eval/decontamination/archiver.py' 2025-11-27T00:44:05,376 adding 'lm_eval/decontamination/decontaminate.py' 2025-11-27T00:44:05,379 adding 'lm_eval/decontamination/janitor.py' 2025-11-27T00:44:05,380 adding 'lm_eval/filters/__init__.py' 2025-11-27T00:44:05,382 adding 'lm_eval/filters/custom.py' 2025-11-27T00:44:05,383 adding 'lm_eval/filters/decontamination.py' 2025-11-27T00:44:05,385 adding 'lm_eval/filters/extraction.py' 2025-11-27T00:44:05,386 adding 'lm_eval/filters/selection.py' 2025-11-27T00:44:05,387 adding 'lm_eval/filters/transformation.py' 2025-11-27T00:44:05,389 adding 'lm_eval/loggers/__init__.py' 2025-11-27T00:44:05,392 adding 'lm_eval/loggers/evaluation_tracker.py' 2025-11-27T00:44:05,394 adding 'lm_eval/loggers/utils.py' 2025-11-27T00:44:05,396 adding 'lm_eval/loggers/wandb_logger.py' 2025-11-27T00:44:05,398 adding 'lm_eval/models/__init__.py' 2025-11-27T00:44:05,399 adding 'lm_eval/models/anthropic_llms.py' 2025-11-27T00:44:05,403 adding 'lm_eval/models/api_models.py' 2025-11-27T00:44:05,405 adding 'lm_eval/models/dummy.py' 2025-11-27T00:44:05,406 adding 'lm_eval/models/gguf.py' 2025-11-27T00:44:05,408 adding 'lm_eval/models/hf_audiolm.py' 2025-11-27T00:44:05,410 adding 'lm_eval/models/hf_steered.py' 2025-11-27T00:44:05,414 adding 'lm_eval/models/hf_vlms.py' 2025-11-27T00:44:05,422 adding 'lm_eval/models/huggingface.py' 2025-11-27T00:44:05,425 adding 'lm_eval/models/ibm_watsonx_ai.py' 2025-11-27T00:44:05,427 adding 'lm_eval/models/mamba_lm.py' 2025-11-27T00:44:05,429 adding 'lm_eval/models/nemo_lm.py' 2025-11-27T00:44:05,433 adding 'lm_eval/models/neuron_optimum.py' 2025-11-27T00:44:05,435 adding 'lm_eval/models/openai_completions.py' 2025-11-27T00:44:05,437 adding 'lm_eval/models/optimum_ipex.py' 2025-11-27T00:44:05,438 adding 'lm_eval/models/optimum_lm.py' 2025-11-27T00:44:05,441 adding 'lm_eval/models/sglang_causallms.py' 2025-11-27T00:44:05,443 adding 'lm_eval/models/sglang_generate_API.py' 2025-11-27T00:44:05,444 adding 'lm_eval/models/textsynth.py' 2025-11-27T00:44:05,449 adding 'lm_eval/models/utils.py' 2025-11-27T00:44:05,453 adding 'lm_eval/models/vllm_causallms.py' 2025-11-27T00:44:05,455 adding 'lm_eval/models/vllm_vlms.py' 2025-11-27T00:44:05,457 adding 'lm_eval/prompts/__init__.py' 2025-11-27T00:44:05,467 adding 'lm_eval/tasks/README.md' 2025-11-27T00:44:05,471 adding 'lm_eval/tasks/__init__.py' 2025-11-27T00:44:05,473 adding 'lm_eval/tasks/aclue/README.md' 2025-11-27T00:44:05,474 adding 'lm_eval/tasks/aclue/_aclue.yaml' 2025-11-27T00:44:05,475 adding 'lm_eval/tasks/aclue/_default_template_yaml' 2025-11-27T00:44:05,477 adding 'lm_eval/tasks/aclue/_generate_configs.py' 2025-11-27T00:44:05,478 adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml' 2025-11-27T00:44:05,479 adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml' 2025-11-27T00:44:05,480 adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml' 2025-11-27T00:44:05,482 adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml' 2025-11-27T00:44:05,483 adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml' 2025-11-27T00:44:05,484 adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml' 2025-11-27T00:44:05,485 adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml' 2025-11-27T00:44:05,486 adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml' 2025-11-27T00:44:05,488 adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml' 2025-11-27T00:44:05,489 adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml' 2025-11-27T00:44:05,490 adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml' 2025-11-27T00:44:05,491 adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml' 2025-11-27T00:44:05,492 adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml' 2025-11-27T00:44:05,494 adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml' 2025-11-27T00:44:05,495 adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml' 2025-11-27T00:44:05,497 adding 'lm_eval/tasks/acpbench/README.md' 2025-11-27T00:44:05,499 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml' 2025-11-27T00:44:05,500 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml' 2025-11-27T00:44:05,502 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml' 2025-11-27T00:44:05,503 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml' 2025-11-27T00:44:05,505 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml' 2025-11-27T00:44:05,506 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml' 2025-11-27T00:44:05,508 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml' 2025-11-27T00:44:05,510 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml' 2025-11-27T00:44:05,512 adding 'lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot' 2025-11-27T00:44:05,513 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark' 2025-11-27T00:44:05,517 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_utils.py' 2025-11-27T00:44:05,519 adding 'lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml' 2025-11-27T00:44:05,520 adding 'lm_eval/tasks/acpbench/gen_2shot/app.yaml' 2025-11-27T00:44:05,521 adding 'lm_eval/tasks/acpbench/gen_2shot/just.yaml' 2025-11-27T00:44:05,523 adding 'lm_eval/tasks/acpbench/gen_2shot/land.yaml' 2025-11-27T00:44:05,524 adding 'lm_eval/tasks/acpbench/gen_2shot/next_act.yaml' 2025-11-27T00:44:05,526 adding 'lm_eval/tasks/acpbench/gen_2shot/prog.yaml' 2025-11-27T00:44:05,527 adding 'lm_eval/tasks/acpbench/gen_2shot/reach.yaml' 2025-11-27T00:44:05,528 adding 'lm_eval/tasks/acpbench/gen_2shot/val.yaml' 2025-11-27T00:44:05,530 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot' 2025-11-27T00:44:05,531 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark' 2025-11-27T00:44:05,536 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py' 2025-11-27T00:44:05,538 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml' 2025-11-27T00:44:05,540 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml' 2025-11-27T00:44:05,541 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml' 2025-11-27T00:44:05,543 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml' 2025-11-27T00:44:05,545 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml' 2025-11-27T00:44:05,547 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml' 2025-11-27T00:44:05,549 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml' 2025-11-27T00:44:05,552 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml' 2025-11-27T00:44:05,554 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml' 2025-11-27T00:44:05,556 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml' 2025-11-27T00:44:05,558 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml' 2025-11-27T00:44:05,559 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml' 2025-11-27T00:44:05,561 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml' 2025-11-27T00:44:05,563 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml' 2025-11-27T00:44:05,565 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml' 2025-11-27T00:44:05,566 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml' 2025-11-27T00:44:05,569 adding 'lm_eval/tasks/aexams/README.md' 2025-11-27T00:44:05,570 adding 'lm_eval/tasks/aexams/_aexams.yaml' 2025-11-27T00:44:05,572 adding 'lm_eval/tasks/aexams/_default_template_yaml' 2025-11-27T00:44:05,573 adding 'lm_eval/tasks/aexams/aexams_Biology.yaml' 2025-11-27T00:44:05,575 adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml' 2025-11-27T00:44:05,576 adding 'lm_eval/tasks/aexams/aexams_Physics.yaml' 2025-11-27T00:44:05,578 adding 'lm_eval/tasks/aexams/aexams_Science.yaml' 2025-11-27T00:44:05,579 adding 'lm_eval/tasks/aexams/aexams_Social.yaml' 2025-11-27T00:44:05,582 adding 'lm_eval/tasks/afrimgsm/README.md' 2025-11-27T00:44:05,583 adding 'lm_eval/tasks/afrimgsm/gen_utils.py' 2025-11-27T00:44:05,585 adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh' 2025-11-27T00:44:05,586 adding 'lm_eval/tasks/afrimgsm/run.sh' 2025-11-27T00:44:05,588 adding 'lm_eval/tasks/afrimgsm/utils.py' 2025-11-27T00:44:05,591 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml' 2025-11-27T00:44:05,593 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml' 2025-11-27T00:44:05,595 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml' 2025-11-27T00:44:05,596 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml' 2025-11-27T00:44:05,598 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml' 2025-11-27T00:44:05,599 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml' 2025-11-27T00:44:05,600 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml' 2025-11-27T00:44:05,602 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml' 2025-11-27T00:44:05,603 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml' 2025-11-27T00:44:05,604 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml' 2025-11-27T00:44:05,606 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml' 2025-11-27T00:44:05,607 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml' 2025-11-27T00:44:05,608 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml' 2025-11-27T00:44:05,610 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml' 2025-11-27T00:44:05,611 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml' 2025-11-27T00:44:05,612 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml' 2025-11-27T00:44:05,614 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml' 2025-11-27T00:44:05,615 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml' 2025-11-27T00:44:05,617 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml' 2025-11-27T00:44:05,618 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml' 2025-11-27T00:44:05,620 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml' 2025-11-27T00:44:05,622 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml' 2025-11-27T00:44:05,623 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml' 2025-11-27T00:44:05,625 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml' 2025-11-27T00:44:05,626 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml' 2025-11-27T00:44:05,627 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml' 2025-11-27T00:44:05,629 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml' 2025-11-27T00:44:05,630 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml' 2025-11-27T00:44:05,632 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml' 2025-11-27T00:44:05,633 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml' 2025-11-27T00:44:05,634 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml' 2025-11-27T00:44:05,636 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml' 2025-11-27T00:44:05,637 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml' 2025-11-27T00:44:05,639 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml' 2025-11-27T00:44:05,640 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml' 2025-11-27T00:44:05,641 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml' 2025-11-27T00:44:05,643 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml' 2025-11-27T00:44:05,644 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml' 2025-11-27T00:44:05,646 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml' 2025-11-27T00:44:05,647 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml' 2025-11-27T00:44:05,649 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml' 2025-11-27T00:44:05,650 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml' 2025-11-27T00:44:05,652 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml' 2025-11-27T00:44:05,653 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml' 2025-11-27T00:44:05,654 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml' 2025-11-27T00:44:05,655 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml' 2025-11-27T00:44:05,656 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml' 2025-11-27T00:44:05,658 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml' 2025-11-27T00:44:05,659 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml' 2025-11-27T00:44:05,660 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml' 2025-11-27T00:44:05,661 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml' 2025-11-27T00:44:05,662 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml' 2025-11-27T00:44:05,664 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml' 2025-11-27T00:44:05,665 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml' 2025-11-27T00:44:05,666 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml' 2025-11-27T00:44:05,667 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml' 2025-11-27T00:44:05,668 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml' 2025-11-27T00:44:05,669 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml' 2025-11-27T00:44:05,670 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml' 2025-11-27T00:44:05,671 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml' 2025-11-27T00:44:05,673 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml' 2025-11-27T00:44:05,675 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml' 2025-11-27T00:44:05,676 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml' 2025-11-27T00:44:05,677 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml' 2025-11-27T00:44:05,679 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml' 2025-11-27T00:44:05,680 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml' 2025-11-27T00:44:05,681 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml' 2025-11-27T00:44:05,682 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml' 2025-11-27T00:44:05,683 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml' 2025-11-27T00:44:05,684 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml' 2025-11-27T00:44:05,686 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml' 2025-11-27T00:44:05,687 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml' 2025-11-27T00:44:05,688 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml' 2025-11-27T00:44:05,689 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml' 2025-11-27T00:44:05,690 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml' 2025-11-27T00:44:05,692 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml' 2025-11-27T00:44:05,693 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml' 2025-11-27T00:44:05,694 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml' 2025-11-27T00:44:05,695 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml' 2025-11-27T00:44:05,697 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml' 2025-11-27T00:44:05,698 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml' 2025-11-27T00:44:05,700 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml' 2025-11-27T00:44:05,701 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml' 2025-11-27T00:44:05,702 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml' 2025-11-27T00:44:05,704 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml' 2025-11-27T00:44:05,705 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml' 2025-11-27T00:44:05,706 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml' 2025-11-27T00:44:05,707 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml' 2025-11-27T00:44:05,708 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml' 2025-11-27T00:44:05,710 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml' 2025-11-27T00:44:05,711 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml' 2025-11-27T00:44:05,712 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml' 2025-11-27T00:44:05,713 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml' 2025-11-27T00:44:05,715 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml' 2025-11-27T00:44:05,716 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml' 2025-11-27T00:44:05,717 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml' 2025-11-27T00:44:05,719 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml' 2025-11-27T00:44:05,720 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml' 2025-11-27T00:44:05,721 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml' 2025-11-27T00:44:05,722 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml' 2025-11-27T00:44:05,723 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml' 2025-11-27T00:44:05,725 adding 'lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml' 2025-11-27T00:44:05,727 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml' 2025-11-27T00:44:05,728 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml' 2025-11-27T00:44:05,729 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml' 2025-11-27T00:44:05,730 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml' 2025-11-27T00:44:05,731 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml' 2025-11-27T00:44:05,733 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml' 2025-11-27T00:44:05,734 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml' 2025-11-27T00:44:05,735 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml' 2025-11-27T00:44:05,736 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml' 2025-11-27T00:44:05,737 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml' 2025-11-27T00:44:05,738 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml' 2025-11-27T00:44:05,739 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml' 2025-11-27T00:44:05,741 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml' 2025-11-27T00:44:05,742 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml' 2025-11-27T00:44:05,743 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml' 2025-11-27T00:44:05,744 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml' 2025-11-27T00:44:05,745 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml' 2025-11-27T00:44:05,746 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml' 2025-11-27T00:44:05,747 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml' 2025-11-27T00:44:05,749 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml' 2025-11-27T00:44:05,750 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml' 2025-11-27T00:44:05,752 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml' 2025-11-27T00:44:05,753 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml' 2025-11-27T00:44:05,754 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml' 2025-11-27T00:44:05,755 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml' 2025-11-27T00:44:05,756 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml' 2025-11-27T00:44:05,757 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml' 2025-11-27T00:44:05,759 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml' 2025-11-27T00:44:05,760 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml' 2025-11-27T00:44:05,761 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml' 2025-11-27T00:44:05,762 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml' 2025-11-27T00:44:05,763 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml' 2025-11-27T00:44:05,765 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml' 2025-11-27T00:44:05,766 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml' 2025-11-27T00:44:05,767 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml' 2025-11-27T00:44:05,768 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml' 2025-11-27T00:44:05,769 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml' 2025-11-27T00:44:05,770 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml' 2025-11-27T00:44:05,771 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml' 2025-11-27T00:44:05,772 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml' 2025-11-27T00:44:05,774 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml' 2025-11-27T00:44:05,775 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml' 2025-11-27T00:44:05,776 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml' 2025-11-27T00:44:05,777 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml' 2025-11-27T00:44:05,778 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml' 2025-11-27T00:44:05,780 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml' 2025-11-27T00:44:05,781 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml' 2025-11-27T00:44:05,782 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml' 2025-11-27T00:44:05,783 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml' 2025-11-27T00:44:05,784 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml' 2025-11-27T00:44:05,785 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml' 2025-11-27T00:44:05,786 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml' 2025-11-27T00:44:05,787 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml' 2025-11-27T00:44:05,789 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml' 2025-11-27T00:44:05,790 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml' 2025-11-27T00:44:05,791 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml' 2025-11-27T00:44:05,792 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml' 2025-11-27T00:44:05,793 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml' 2025-11-27T00:44:05,795 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml' 2025-11-27T00:44:05,796 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml' 2025-11-27T00:44:05,797 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml' 2025-11-27T00:44:05,799 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml' 2025-11-27T00:44:05,800 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml' 2025-11-27T00:44:05,801 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml' 2025-11-27T00:44:05,802 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml' 2025-11-27T00:44:05,804 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml' 2025-11-27T00:44:05,805 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml' 2025-11-27T00:44:05,806 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml' 2025-11-27T00:44:05,807 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml' 2025-11-27T00:44:05,808 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml' 2025-11-27T00:44:05,810 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml' 2025-11-27T00:44:05,811 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml' 2025-11-27T00:44:05,812 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml' 2025-11-27T00:44:05,813 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml' 2025-11-27T00:44:05,814 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml' 2025-11-27T00:44:05,816 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml' 2025-11-27T00:44:05,817 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml' 2025-11-27T00:44:05,818 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml' 2025-11-27T00:44:05,819 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml' 2025-11-27T00:44:05,820 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml' 2025-11-27T00:44:05,822 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml' 2025-11-27T00:44:05,823 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml' 2025-11-27T00:44:05,824 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml' 2025-11-27T00:44:05,825 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml' 2025-11-27T00:44:05,827 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml' 2025-11-27T00:44:05,828 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml' 2025-11-27T00:44:05,829 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml' 2025-11-27T00:44:05,830 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml' 2025-11-27T00:44:05,831 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml' 2025-11-27T00:44:05,833 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml' 2025-11-27T00:44:05,834 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml' 2025-11-27T00:44:05,835 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml' 2025-11-27T00:44:05,836 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml' 2025-11-27T00:44:05,837 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml' 2025-11-27T00:44:05,838 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml' 2025-11-27T00:44:05,840 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml' 2025-11-27T00:44:05,841 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml' 2025-11-27T00:44:05,842 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml' 2025-11-27T00:44:05,843 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml' 2025-11-27T00:44:05,844 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml' 2025-11-27T00:44:05,846 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml' 2025-11-27T00:44:05,848 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml' 2025-11-27T00:44:05,850 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml' 2025-11-27T00:44:05,851 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml' 2025-11-27T00:44:05,852 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml' 2025-11-27T00:44:05,853 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml' 2025-11-27T00:44:05,854 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml' 2025-11-27T00:44:05,855 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml' 2025-11-27T00:44:05,857 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml' 2025-11-27T00:44:05,858 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml' 2025-11-27T00:44:05,859 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml' 2025-11-27T00:44:05,860 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml' 2025-11-27T00:44:05,861 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml' 2025-11-27T00:44:05,862 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml' 2025-11-27T00:44:05,864 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml' 2025-11-27T00:44:05,865 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml' 2025-11-27T00:44:05,866 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml' 2025-11-27T00:44:05,867 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml' 2025-11-27T00:44:05,868 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml' 2025-11-27T00:44:05,870 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml' 2025-11-27T00:44:05,871 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml' 2025-11-27T00:44:05,872 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml' 2025-11-27T00:44:05,873 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml' 2025-11-27T00:44:05,875 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml' 2025-11-27T00:44:05,876 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml' 2025-11-27T00:44:05,877 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml' 2025-11-27T00:44:05,878 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml' 2025-11-27T00:44:05,879 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml' 2025-11-27T00:44:05,880 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml' 2025-11-27T00:44:05,881 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml' 2025-11-27T00:44:05,882 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml' 2025-11-27T00:44:05,884 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml' 2025-11-27T00:44:05,885 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml' 2025-11-27T00:44:05,886 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml' 2025-11-27T00:44:05,887 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml' 2025-11-27T00:44:05,888 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml' 2025-11-27T00:44:05,889 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml' 2025-11-27T00:44:05,891 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml' 2025-11-27T00:44:05,892 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml' 2025-11-27T00:44:05,893 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml' 2025-11-27T00:44:05,894 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml' 2025-11-27T00:44:05,896 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml' 2025-11-27T00:44:05,897 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml' 2025-11-27T00:44:05,898 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml' 2025-11-27T00:44:05,899 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml' 2025-11-27T00:44:05,900 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml' 2025-11-27T00:44:05,901 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml' 2025-11-27T00:44:05,902 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml' 2025-11-27T00:44:05,903 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml' 2025-11-27T00:44:05,905 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml' 2025-11-27T00:44:05,906 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml' 2025-11-27T00:44:05,907 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml' 2025-11-27T00:44:05,908 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml' 2025-11-27T00:44:05,909 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml' 2025-11-27T00:44:05,911 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml' 2025-11-27T00:44:05,912 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml' 2025-11-27T00:44:05,914 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml' 2025-11-27T00:44:05,915 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml' 2025-11-27T00:44:05,916 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml' 2025-11-27T00:44:05,917 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml' 2025-11-27T00:44:05,918 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml' 2025-11-27T00:44:05,919 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml' 2025-11-27T00:44:05,920 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml' 2025-11-27T00:44:05,921 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml' 2025-11-27T00:44:05,923 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml' 2025-11-27T00:44:05,924 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml' 2025-11-27T00:44:05,925 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml' 2025-11-27T00:44:05,926 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml' 2025-11-27T00:44:05,927 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml' 2025-11-27T00:44:05,929 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml' 2025-11-27T00:44:05,930 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml' 2025-11-27T00:44:05,931 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml' 2025-11-27T00:44:05,932 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml' 2025-11-27T00:44:05,934 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml' 2025-11-27T00:44:05,935 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml' 2025-11-27T00:44:05,936 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml' 2025-11-27T00:44:05,937 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml' 2025-11-27T00:44:05,939 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml' 2025-11-27T00:44:05,940 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml' 2025-11-27T00:44:05,941 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml' 2025-11-27T00:44:05,942 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml' 2025-11-27T00:44:05,944 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml' 2025-11-27T00:44:05,945 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml' 2025-11-27T00:44:05,946 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml' 2025-11-27T00:44:05,947 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml' 2025-11-27T00:44:05,948 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml' 2025-11-27T00:44:05,949 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml' 2025-11-27T00:44:05,951 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml' 2025-11-27T00:44:05,952 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml' 2025-11-27T00:44:05,953 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml' 2025-11-27T00:44:05,954 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml' 2025-11-27T00:44:05,956 adding 'lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml' 2025-11-27T00:44:05,958 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml' 2025-11-27T00:44:05,959 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml' 2025-11-27T00:44:05,960 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml' 2025-11-27T00:44:05,962 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml' 2025-11-27T00:44:05,963 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml' 2025-11-27T00:44:05,964 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml' 2025-11-27T00:44:05,965 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml' 2025-11-27T00:44:05,966 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml' 2025-11-27T00:44:05,967 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml' 2025-11-27T00:44:05,968 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml' 2025-11-27T00:44:05,969 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml' 2025-11-27T00:44:05,971 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml' 2025-11-27T00:44:05,972 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml' 2025-11-27T00:44:05,973 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml' 2025-11-27T00:44:05,974 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml' 2025-11-27T00:44:05,975 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml' 2025-11-27T00:44:05,976 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml' 2025-11-27T00:44:05,978 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml' 2025-11-27T00:44:05,979 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml' 2025-11-27T00:44:05,981 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml' 2025-11-27T00:44:05,982 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml' 2025-11-27T00:44:05,983 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml' 2025-11-27T00:44:05,984 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml' 2025-11-27T00:44:05,985 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml' 2025-11-27T00:44:05,986 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml' 2025-11-27T00:44:05,988 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml' 2025-11-27T00:44:05,989 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml' 2025-11-27T00:44:05,990 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml' 2025-11-27T00:44:05,991 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml' 2025-11-27T00:44:05,992 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml' 2025-11-27T00:44:05,993 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml' 2025-11-27T00:44:05,995 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml' 2025-11-27T00:44:05,996 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml' 2025-11-27T00:44:05,997 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml' 2025-11-27T00:44:05,998 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml' 2025-11-27T00:44:05,999 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml' 2025-11-27T00:44:06,001 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml' 2025-11-27T00:44:06,002 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml' 2025-11-27T00:44:06,004 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml' 2025-11-27T00:44:06,005 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml' 2025-11-27T00:44:06,007 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml' 2025-11-27T00:44:06,008 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml' 2025-11-27T00:44:06,009 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml' 2025-11-27T00:44:06,010 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml' 2025-11-27T00:44:06,011 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml' 2025-11-27T00:44:06,012 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml' 2025-11-27T00:44:06,013 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml' 2025-11-27T00:44:06,014 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml' 2025-11-27T00:44:06,016 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml' 2025-11-27T00:44:06,017 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml' 2025-11-27T00:44:06,018 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml' 2025-11-27T00:44:06,019 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml' 2025-11-27T00:44:06,021 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml' 2025-11-27T00:44:06,022 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml' 2025-11-27T00:44:06,023 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml' 2025-11-27T00:44:06,024 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml' 2025-11-27T00:44:06,025 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml' 2025-11-27T00:44:06,027 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml' 2025-11-27T00:44:06,028 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml' 2025-11-27T00:44:06,029 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml' 2025-11-27T00:44:06,031 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml' 2025-11-27T00:44:06,032 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml' 2025-11-27T00:44:06,033 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml' 2025-11-27T00:44:06,035 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml' 2025-11-27T00:44:06,036 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml' 2025-11-27T00:44:06,037 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml' 2025-11-27T00:44:06,038 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml' 2025-11-27T00:44:06,039 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml' 2025-11-27T00:44:06,041 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml' 2025-11-27T00:44:06,042 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml' 2025-11-27T00:44:06,043 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml' 2025-11-27T00:44:06,044 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml' 2025-11-27T00:44:06,045 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml' 2025-11-27T00:44:06,047 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml' 2025-11-27T00:44:06,048 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml' 2025-11-27T00:44:06,049 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml' 2025-11-27T00:44:06,051 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml' 2025-11-27T00:44:06,052 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml' 2025-11-27T00:44:06,053 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml' 2025-11-27T00:44:06,054 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml' 2025-11-27T00:44:06,055 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml' 2025-11-27T00:44:06,057 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml' 2025-11-27T00:44:06,058 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml' 2025-11-27T00:44:06,059 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml' 2025-11-27T00:44:06,060 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml' 2025-11-27T00:44:06,061 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml' 2025-11-27T00:44:06,063 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml' 2025-11-27T00:44:06,064 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml' 2025-11-27T00:44:06,065 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml' 2025-11-27T00:44:06,066 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml' 2025-11-27T00:44:06,067 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml' 2025-11-27T00:44:06,068 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml' 2025-11-27T00:44:06,070 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml' 2025-11-27T00:44:06,071 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml' 2025-11-27T00:44:06,072 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml' 2025-11-27T00:44:06,074 adding 'lm_eval/tasks/afrimmlu/README.md' 2025-11-27T00:44:06,075 adding 'lm_eval/tasks/afrimmlu/fewshot.sh' 2025-11-27T00:44:06,076 adding 'lm_eval/tasks/afrimmlu/gen_utils.py' 2025-11-27T00:44:06,078 adding 'lm_eval/tasks/afrimmlu/utils.py' 2025-11-27T00:44:06,079 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml' 2025-11-27T00:44:06,081 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct' 2025-11-27T00:44:06,082 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml' 2025-11-27T00:44:06,083 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml' 2025-11-27T00:44:06,084 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml' 2025-11-27T00:44:06,086 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml' 2025-11-27T00:44:06,087 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml' 2025-11-27T00:44:06,088 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml' 2025-11-27T00:44:06,089 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml' 2025-11-27T00:44:06,090 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml' 2025-11-27T00:44:06,091 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml' 2025-11-27T00:44:06,092 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml' 2025-11-27T00:44:06,093 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml' 2025-11-27T00:44:06,095 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml' 2025-11-27T00:44:06,096 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml' 2025-11-27T00:44:06,097 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml' 2025-11-27T00:44:06,098 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml' 2025-11-27T00:44:06,100 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml' 2025-11-27T00:44:06,101 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml' 2025-11-27T00:44:06,102 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml' 2025-11-27T00:44:06,103 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py' 2025-11-27T00:44:06,105 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct' 2025-11-27T00:44:06,106 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml' 2025-11-27T00:44:06,107 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml' 2025-11-27T00:44:06,108 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml' 2025-11-27T00:44:06,109 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml' 2025-11-27T00:44:06,110 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml' 2025-11-27T00:44:06,111 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml' 2025-11-27T00:44:06,112 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml' 2025-11-27T00:44:06,114 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml' 2025-11-27T00:44:06,115 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml' 2025-11-27T00:44:06,116 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml' 2025-11-27T00:44:06,117 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml' 2025-11-27T00:44:06,118 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml' 2025-11-27T00:44:06,119 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml' 2025-11-27T00:44:06,120 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml' 2025-11-27T00:44:06,121 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml' 2025-11-27T00:44:06,123 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml' 2025-11-27T00:44:06,124 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml' 2025-11-27T00:44:06,125 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml' 2025-11-27T00:44:06,126 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py' 2025-11-27T00:44:06,128 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct' 2025-11-27T00:44:06,129 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml' 2025-11-27T00:44:06,130 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml' 2025-11-27T00:44:06,131 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml' 2025-11-27T00:44:06,132 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml' 2025-11-27T00:44:06,134 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml' 2025-11-27T00:44:06,135 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml' 2025-11-27T00:44:06,136 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml' 2025-11-27T00:44:06,137 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml' 2025-11-27T00:44:06,138 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml' 2025-11-27T00:44:06,139 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml' 2025-11-27T00:44:06,141 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml' 2025-11-27T00:44:06,142 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml' 2025-11-27T00:44:06,143 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml' 2025-11-27T00:44:06,144 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml' 2025-11-27T00:44:06,145 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml' 2025-11-27T00:44:06,146 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml' 2025-11-27T00:44:06,147 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml' 2025-11-27T00:44:06,149 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml' 2025-11-27T00:44:06,150 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py' 2025-11-27T00:44:06,152 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct' 2025-11-27T00:44:06,153 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml' 2025-11-27T00:44:06,154 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml' 2025-11-27T00:44:06,155 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml' 2025-11-27T00:44:06,156 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml' 2025-11-27T00:44:06,157 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml' 2025-11-27T00:44:06,158 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml' 2025-11-27T00:44:06,160 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml' 2025-11-27T00:44:06,161 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml' 2025-11-27T00:44:06,162 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml' 2025-11-27T00:44:06,163 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml' 2025-11-27T00:44:06,164 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml' 2025-11-27T00:44:06,165 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml' 2025-11-27T00:44:06,166 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml' 2025-11-27T00:44:06,167 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml' 2025-11-27T00:44:06,168 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml' 2025-11-27T00:44:06,169 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml' 2025-11-27T00:44:06,170 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml' 2025-11-27T00:44:06,172 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml' 2025-11-27T00:44:06,173 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py' 2025-11-27T00:44:06,175 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct' 2025-11-27T00:44:06,176 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml' 2025-11-27T00:44:06,177 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml' 2025-11-27T00:44:06,178 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml' 2025-11-27T00:44:06,179 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml' 2025-11-27T00:44:06,180 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml' 2025-11-27T00:44:06,182 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml' 2025-11-27T00:44:06,183 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml' 2025-11-27T00:44:06,184 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml' 2025-11-27T00:44:06,185 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml' 2025-11-27T00:44:06,186 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml' 2025-11-27T00:44:06,187 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml' 2025-11-27T00:44:06,189 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml' 2025-11-27T00:44:06,190 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml' 2025-11-27T00:44:06,191 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml' 2025-11-27T00:44:06,193 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml' 2025-11-27T00:44:06,194 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml' 2025-11-27T00:44:06,195 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml' 2025-11-27T00:44:06,196 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml' 2025-11-27T00:44:06,197 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py' 2025-11-27T00:44:06,199 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml' 2025-11-27T00:44:06,201 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate' 2025-11-27T00:44:06,202 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml' 2025-11-27T00:44:06,203 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml' 2025-11-27T00:44:06,204 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml' 2025-11-27T00:44:06,205 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml' 2025-11-27T00:44:06,206 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml' 2025-11-27T00:44:06,207 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml' 2025-11-27T00:44:06,208 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml' 2025-11-27T00:44:06,209 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml' 2025-11-27T00:44:06,211 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml' 2025-11-27T00:44:06,212 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml' 2025-11-27T00:44:06,213 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml' 2025-11-27T00:44:06,214 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml' 2025-11-27T00:44:06,215 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml' 2025-11-27T00:44:06,216 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml' 2025-11-27T00:44:06,217 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml' 2025-11-27T00:44:06,218 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml' 2025-11-27T00:44:06,219 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml' 2025-11-27T00:44:06,220 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py' 2025-11-27T00:44:06,222 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate' 2025-11-27T00:44:06,224 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml' 2025-11-27T00:44:06,225 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml' 2025-11-27T00:44:06,226 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml' 2025-11-27T00:44:06,227 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml' 2025-11-27T00:44:06,228 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml' 2025-11-27T00:44:06,230 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml' 2025-11-27T00:44:06,231 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml' 2025-11-27T00:44:06,232 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml' 2025-11-27T00:44:06,233 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml' 2025-11-27T00:44:06,234 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml' 2025-11-27T00:44:06,235 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml' 2025-11-27T00:44:06,236 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml' 2025-11-27T00:44:06,237 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml' 2025-11-27T00:44:06,239 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml' 2025-11-27T00:44:06,240 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml' 2025-11-27T00:44:06,241 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml' 2025-11-27T00:44:06,242 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml' 2025-11-27T00:44:06,243 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py' 2025-11-27T00:44:06,245 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate' 2025-11-27T00:44:06,247 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml' 2025-11-27T00:44:06,248 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml' 2025-11-27T00:44:06,249 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml' 2025-11-27T00:44:06,250 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml' 2025-11-27T00:44:06,251 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml' 2025-11-27T00:44:06,252 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml' 2025-11-27T00:44:06,253 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml' 2025-11-27T00:44:06,254 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml' 2025-11-27T00:44:06,255 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml' 2025-11-27T00:44:06,256 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml' 2025-11-27T00:44:06,257 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml' 2025-11-27T00:44:06,258 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml' 2025-11-27T00:44:06,259 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml' 2025-11-27T00:44:06,261 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml' 2025-11-27T00:44:06,262 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml' 2025-11-27T00:44:06,263 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml' 2025-11-27T00:44:06,264 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml' 2025-11-27T00:44:06,265 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py' 2025-11-27T00:44:06,267 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate' 2025-11-27T00:44:06,268 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml' 2025-11-27T00:44:06,269 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml' 2025-11-27T00:44:06,270 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml' 2025-11-27T00:44:06,271 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml' 2025-11-27T00:44:06,273 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml' 2025-11-27T00:44:06,274 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml' 2025-11-27T00:44:06,275 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml' 2025-11-27T00:44:06,276 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml' 2025-11-27T00:44:06,277 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml' 2025-11-27T00:44:06,278 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml' 2025-11-27T00:44:06,279 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml' 2025-11-27T00:44:06,281 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml' 2025-11-27T00:44:06,282 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml' 2025-11-27T00:44:06,283 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml' 2025-11-27T00:44:06,284 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml' 2025-11-27T00:44:06,285 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml' 2025-11-27T00:44:06,286 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml' 2025-11-27T00:44:06,287 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py' 2025-11-27T00:44:06,289 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate' 2025-11-27T00:44:06,291 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml' 2025-11-27T00:44:06,292 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml' 2025-11-27T00:44:06,293 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml' 2025-11-27T00:44:06,294 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml' 2025-11-27T00:44:06,295 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml' 2025-11-27T00:44:06,296 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml' 2025-11-27T00:44:06,297 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml' 2025-11-27T00:44:06,298 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml' 2025-11-27T00:44:06,299 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml' 2025-11-27T00:44:06,300 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml' 2025-11-27T00:44:06,301 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml' 2025-11-27T00:44:06,303 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml' 2025-11-27T00:44:06,304 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml' 2025-11-27T00:44:06,305 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml' 2025-11-27T00:44:06,306 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml' 2025-11-27T00:44:06,307 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml' 2025-11-27T00:44:06,308 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml' 2025-11-27T00:44:06,309 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py' 2025-11-27T00:44:06,311 adding 'lm_eval/tasks/afrixnli/README.md' 2025-11-27T00:44:06,313 adding 'lm_eval/tasks/afrixnli/gen_utils.py' 2025-11-27T00:44:06,314 adding 'lm_eval/tasks/afrixnli/utils.py' 2025-11-27T00:44:06,317 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml' 2025-11-27T00:44:06,318 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml' 2025-11-27T00:44:06,319 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml' 2025-11-27T00:44:06,320 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml' 2025-11-27T00:44:06,321 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml' 2025-11-27T00:44:06,322 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml' 2025-11-27T00:44:06,323 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml' 2025-11-27T00:44:06,325 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml' 2025-11-27T00:44:06,326 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml' 2025-11-27T00:44:06,327 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml' 2025-11-27T00:44:06,328 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml' 2025-11-27T00:44:06,329 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml' 2025-11-27T00:44:06,330 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml' 2025-11-27T00:44:06,331 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml' 2025-11-27T00:44:06,333 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml' 2025-11-27T00:44:06,334 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml' 2025-11-27T00:44:06,335 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml' 2025-11-27T00:44:06,336 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml' 2025-11-27T00:44:06,337 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml' 2025-11-27T00:44:06,338 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py' 2025-11-27T00:44:06,340 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml' 2025-11-27T00:44:06,341 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml' 2025-11-27T00:44:06,343 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml' 2025-11-27T00:44:06,344 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml' 2025-11-27T00:44:06,345 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml' 2025-11-27T00:44:06,346 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml' 2025-11-27T00:44:06,347 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml' 2025-11-27T00:44:06,348 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml' 2025-11-27T00:44:06,349 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml' 2025-11-27T00:44:06,350 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml' 2025-11-27T00:44:06,351 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml' 2025-11-27T00:44:06,352 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml' 2025-11-27T00:44:06,354 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml' 2025-11-27T00:44:06,355 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml' 2025-11-27T00:44:06,356 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml' 2025-11-27T00:44:06,357 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml' 2025-11-27T00:44:06,358 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml' 2025-11-27T00:44:06,359 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml' 2025-11-27T00:44:06,360 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml' 2025-11-27T00:44:06,361 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py' 2025-11-27T00:44:06,363 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,364 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,366 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,367 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,368 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,369 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,370 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,371 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,373 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,374 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,375 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,376 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,377 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,378 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,380 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,381 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml' 2025-11-27T00:44:06,382 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,383 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,384 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py' 2025-11-27T00:44:06,386 adding 'lm_eval/tasks/afrixnli/direct/afrixnli.yaml' 2025-11-27T00:44:06,388 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml' 2025-11-27T00:44:06,389 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml' 2025-11-27T00:44:06,390 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml' 2025-11-27T00:44:06,391 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml' 2025-11-27T00:44:06,392 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml' 2025-11-27T00:44:06,393 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml' 2025-11-27T00:44:06,394 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml' 2025-11-27T00:44:06,395 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml' 2025-11-27T00:44:06,396 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml' 2025-11-27T00:44:06,398 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml' 2025-11-27T00:44:06,399 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml' 2025-11-27T00:44:06,400 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml' 2025-11-27T00:44:06,401 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml' 2025-11-27T00:44:06,402 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml' 2025-11-27T00:44:06,403 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml' 2025-11-27T00:44:06,404 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml' 2025-11-27T00:44:06,405 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml' 2025-11-27T00:44:06,407 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml' 2025-11-27T00:44:06,408 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml' 2025-11-27T00:44:06,409 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/utils.py' 2025-11-27T00:44:06,411 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml' 2025-11-27T00:44:06,412 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml' 2025-11-27T00:44:06,413 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml' 2025-11-27T00:44:06,414 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml' 2025-11-27T00:44:06,416 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml' 2025-11-27T00:44:06,417 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml' 2025-11-27T00:44:06,418 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml' 2025-11-27T00:44:06,419 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml' 2025-11-27T00:44:06,420 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml' 2025-11-27T00:44:06,421 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml' 2025-11-27T00:44:06,422 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml' 2025-11-27T00:44:06,423 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml' 2025-11-27T00:44:06,425 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml' 2025-11-27T00:44:06,426 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml' 2025-11-27T00:44:06,427 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml' 2025-11-27T00:44:06,428 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml' 2025-11-27T00:44:06,429 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml' 2025-11-27T00:44:06,430 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml' 2025-11-27T00:44:06,431 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml' 2025-11-27T00:44:06,433 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/utils.py' 2025-11-27T00:44:06,435 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml' 2025-11-27T00:44:06,436 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml' 2025-11-27T00:44:06,437 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml' 2025-11-27T00:44:06,438 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml' 2025-11-27T00:44:06,439 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml' 2025-11-27T00:44:06,440 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml' 2025-11-27T00:44:06,441 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml' 2025-11-27T00:44:06,442 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml' 2025-11-27T00:44:06,443 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml' 2025-11-27T00:44:06,445 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml' 2025-11-27T00:44:06,446 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml' 2025-11-27T00:44:06,447 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml' 2025-11-27T00:44:06,448 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml' 2025-11-27T00:44:06,449 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml' 2025-11-27T00:44:06,450 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml' 2025-11-27T00:44:06,452 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml' 2025-11-27T00:44:06,453 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml' 2025-11-27T00:44:06,454 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml' 2025-11-27T00:44:06,455 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml' 2025-11-27T00:44:06,456 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/utils.py' 2025-11-27T00:44:06,458 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml' 2025-11-27T00:44:06,459 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml' 2025-11-27T00:44:06,461 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml' 2025-11-27T00:44:06,462 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml' 2025-11-27T00:44:06,463 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml' 2025-11-27T00:44:06,464 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml' 2025-11-27T00:44:06,465 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml' 2025-11-27T00:44:06,466 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml' 2025-11-27T00:44:06,467 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml' 2025-11-27T00:44:06,469 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml' 2025-11-27T00:44:06,470 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml' 2025-11-27T00:44:06,471 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml' 2025-11-27T00:44:06,472 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml' 2025-11-27T00:44:06,473 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml' 2025-11-27T00:44:06,474 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml' 2025-11-27T00:44:06,476 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml' 2025-11-27T00:44:06,477 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml' 2025-11-27T00:44:06,478 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml' 2025-11-27T00:44:06,479 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml' 2025-11-27T00:44:06,480 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/utils.py' 2025-11-27T00:44:06,482 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml' 2025-11-27T00:44:06,483 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml' 2025-11-27T00:44:06,485 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml' 2025-11-27T00:44:06,486 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml' 2025-11-27T00:44:06,487 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml' 2025-11-27T00:44:06,488 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml' 2025-11-27T00:44:06,489 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml' 2025-11-27T00:44:06,491 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml' 2025-11-27T00:44:06,492 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml' 2025-11-27T00:44:06,493 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml' 2025-11-27T00:44:06,494 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml' 2025-11-27T00:44:06,495 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml' 2025-11-27T00:44:06,496 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml' 2025-11-27T00:44:06,497 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml' 2025-11-27T00:44:06,498 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml' 2025-11-27T00:44:06,499 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml' 2025-11-27T00:44:06,500 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml' 2025-11-27T00:44:06,501 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml' 2025-11-27T00:44:06,503 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml' 2025-11-27T00:44:06,504 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/utils.py' 2025-11-27T00:44:06,506 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml' 2025-11-27T00:44:06,507 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml' 2025-11-27T00:44:06,508 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml' 2025-11-27T00:44:06,509 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml' 2025-11-27T00:44:06,510 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml' 2025-11-27T00:44:06,511 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml' 2025-11-27T00:44:06,512 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml' 2025-11-27T00:44:06,513 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml' 2025-11-27T00:44:06,514 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml' 2025-11-27T00:44:06,515 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml' 2025-11-27T00:44:06,517 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml' 2025-11-27T00:44:06,518 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml' 2025-11-27T00:44:06,519 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml' 2025-11-27T00:44:06,520 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml' 2025-11-27T00:44:06,521 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml' 2025-11-27T00:44:06,522 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml' 2025-11-27T00:44:06,523 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml' 2025-11-27T00:44:06,524 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml' 2025-11-27T00:44:06,526 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml' 2025-11-27T00:44:06,527 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py' 2025-11-27T00:44:06,529 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml' 2025-11-27T00:44:06,530 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml' 2025-11-27T00:44:06,531 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml' 2025-11-27T00:44:06,532 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml' 2025-11-27T00:44:06,533 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml' 2025-11-27T00:44:06,534 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml' 2025-11-27T00:44:06,535 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml' 2025-11-27T00:44:06,537 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml' 2025-11-27T00:44:06,538 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml' 2025-11-27T00:44:06,539 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml' 2025-11-27T00:44:06,540 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml' 2025-11-27T00:44:06,541 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml' 2025-11-27T00:44:06,542 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml' 2025-11-27T00:44:06,543 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml' 2025-11-27T00:44:06,544 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml' 2025-11-27T00:44:06,545 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml' 2025-11-27T00:44:06,546 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml' 2025-11-27T00:44:06,547 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml' 2025-11-27T00:44:06,549 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py' 2025-11-27T00:44:06,550 adding 'lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml' 2025-11-27T00:44:06,552 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,553 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,554 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,555 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,556 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,558 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,559 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,560 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,561 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,562 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,563 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,564 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,566 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,567 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,568 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,569 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml' 2025-11-27T00:44:06,570 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,572 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,573 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/utils.py' 2025-11-27T00:44:06,575 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,576 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,577 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,578 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,579 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,580 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,582 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,583 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,584 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,585 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,586 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,587 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,588 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,589 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,590 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,591 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml' 2025-11-27T00:44:06,592 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,593 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,595 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/utils.py' 2025-11-27T00:44:06,596 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,598 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,599 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,600 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,601 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,602 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,603 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,604 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,606 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,607 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,608 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,609 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,610 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,611 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,612 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,614 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml' 2025-11-27T00:44:06,615 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,616 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,617 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/utils.py' 2025-11-27T00:44:06,619 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,620 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,622 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,623 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,624 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,625 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,626 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,628 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,629 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,630 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,631 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,632 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,633 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,634 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,635 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,636 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml' 2025-11-27T00:44:06,638 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,639 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,640 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/utils.py' 2025-11-27T00:44:06,642 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml' 2025-11-27T00:44:06,643 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml' 2025-11-27T00:44:06,644 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml' 2025-11-27T00:44:06,645 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml' 2025-11-27T00:44:06,646 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml' 2025-11-27T00:44:06,647 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml' 2025-11-27T00:44:06,649 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml' 2025-11-27T00:44:06,650 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml' 2025-11-27T00:44:06,651 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml' 2025-11-27T00:44:06,652 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml' 2025-11-27T00:44:06,653 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml' 2025-11-27T00:44:06,654 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml' 2025-11-27T00:44:06,655 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml' 2025-11-27T00:44:06,656 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml' 2025-11-27T00:44:06,658 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml' 2025-11-27T00:44:06,659 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml' 2025-11-27T00:44:06,660 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml' 2025-11-27T00:44:06,661 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml' 2025-11-27T00:44:06,662 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/utils.py' 2025-11-27T00:44:06,664 adding 'lm_eval/tasks/afrobench/README.md' 2025-11-27T00:44:06,665 adding 'lm_eval/tasks/afrobench/afrobench-lite.yaml' 2025-11-27T00:44:06,667 adding 'lm_eval/tasks/afrobench/afrobench.yaml' 2025-11-27T00:44:06,668 adding 'lm_eval/tasks/afrobench/adr/README.md' 2025-11-27T00:44:06,670 adding 'lm_eval/tasks/afrobench/adr/afridiacritics.yaml' 2025-11-27T00:44:06,671 adding 'lm_eval/tasks/afrobench/adr/gen_utils.py' 2025-11-27T00:44:06,673 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml' 2025-11-27T00:44:06,674 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml' 2025-11-27T00:44:06,675 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml' 2025-11-27T00:44:06,676 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml' 2025-11-27T00:44:06,677 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml' 2025-11-27T00:44:06,679 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml' 2025-11-27T00:44:06,680 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml' 2025-11-27T00:44:06,681 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml' 2025-11-27T00:44:06,682 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml' 2025-11-27T00:44:06,683 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml' 2025-11-27T00:44:06,685 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml' 2025-11-27T00:44:06,686 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml' 2025-11-27T00:44:06,687 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml' 2025-11-27T00:44:06,688 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml' 2025-11-27T00:44:06,689 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml' 2025-11-27T00:44:06,691 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml' 2025-11-27T00:44:06,692 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml' 2025-11-27T00:44:06,693 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml' 2025-11-27T00:44:06,695 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml' 2025-11-27T00:44:06,696 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml' 2025-11-27T00:44:06,697 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml' 2025-11-27T00:44:06,698 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml' 2025-11-27T00:44:06,699 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml' 2025-11-27T00:44:06,700 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml' 2025-11-27T00:44:06,702 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml' 2025-11-27T00:44:06,703 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml' 2025-11-27T00:44:06,704 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml' 2025-11-27T00:44:06,705 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml' 2025-11-27T00:44:06,707 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml' 2025-11-27T00:44:06,708 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml' 2025-11-27T00:44:06,710 adding 'lm_eval/tasks/afrobench/afriqa/README.md' 2025-11-27T00:44:06,711 adding 'lm_eval/tasks/afrobench/afriqa/afriqa.yaml' 2025-11-27T00:44:06,712 adding 'lm_eval/tasks/afrobench/afriqa/utils.py' 2025-11-27T00:44:06,714 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa' 2025-11-27T00:44:06,716 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml' 2025-11-27T00:44:06,717 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml' 2025-11-27T00:44:06,718 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml' 2025-11-27T00:44:06,719 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml' 2025-11-27T00:44:06,720 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml' 2025-11-27T00:44:06,721 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml' 2025-11-27T00:44:06,723 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml' 2025-11-27T00:44:06,724 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml' 2025-11-27T00:44:06,725 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml' 2025-11-27T00:44:06,726 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py' 2025-11-27T00:44:06,728 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa' 2025-11-27T00:44:06,730 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml' 2025-11-27T00:44:06,731 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml' 2025-11-27T00:44:06,732 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml' 2025-11-27T00:44:06,733 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml' 2025-11-27T00:44:06,734 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml' 2025-11-27T00:44:06,736 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml' 2025-11-27T00:44:06,737 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml' 2025-11-27T00:44:06,738 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml' 2025-11-27T00:44:06,739 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml' 2025-11-27T00:44:06,740 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py' 2025-11-27T00:44:06,742 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa' 2025-11-27T00:44:06,743 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml' 2025-11-27T00:44:06,744 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml' 2025-11-27T00:44:06,746 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml' 2025-11-27T00:44:06,747 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml' 2025-11-27T00:44:06,748 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml' 2025-11-27T00:44:06,749 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml' 2025-11-27T00:44:06,750 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml' 2025-11-27T00:44:06,751 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml' 2025-11-27T00:44:06,753 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml' 2025-11-27T00:44:06,754 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py' 2025-11-27T00:44:06,756 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa' 2025-11-27T00:44:06,757 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml' 2025-11-27T00:44:06,758 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml' 2025-11-27T00:44:06,759 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml' 2025-11-27T00:44:06,760 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml' 2025-11-27T00:44:06,761 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml' 2025-11-27T00:44:06,762 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml' 2025-11-27T00:44:06,764 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml' 2025-11-27T00:44:06,765 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml' 2025-11-27T00:44:06,766 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml' 2025-11-27T00:44:06,767 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py' 2025-11-27T00:44:06,769 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa' 2025-11-27T00:44:06,770 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml' 2025-11-27T00:44:06,771 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml' 2025-11-27T00:44:06,772 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml' 2025-11-27T00:44:06,774 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml' 2025-11-27T00:44:06,775 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml' 2025-11-27T00:44:06,776 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml' 2025-11-27T00:44:06,777 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml' 2025-11-27T00:44:06,778 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml' 2025-11-27T00:44:06,780 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml' 2025-11-27T00:44:06,781 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py' 2025-11-27T00:44:06,783 adding 'lm_eval/tasks/afrobench/afrisenti/README.md' 2025-11-27T00:44:06,784 adding 'lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml' 2025-11-27T00:44:06,785 adding 'lm_eval/tasks/afrobench/afrisenti/fewshot.sh' 2025-11-27T00:44:06,787 adding 'lm_eval/tasks/afrobench/afrisenti/utils.py' 2025-11-27T00:44:06,789 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti' 2025-11-27T00:44:06,790 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml' 2025-11-27T00:44:06,791 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml' 2025-11-27T00:44:06,792 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml' 2025-11-27T00:44:06,793 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml' 2025-11-27T00:44:06,794 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml' 2025-11-27T00:44:06,795 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml' 2025-11-27T00:44:06,796 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml' 2025-11-27T00:44:06,798 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml' 2025-11-27T00:44:06,799 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml' 2025-11-27T00:44:06,800 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml' 2025-11-27T00:44:06,801 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml' 2025-11-27T00:44:06,802 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml' 2025-11-27T00:44:06,803 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml' 2025-11-27T00:44:06,804 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml' 2025-11-27T00:44:06,805 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh' 2025-11-27T00:44:06,806 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py' 2025-11-27T00:44:06,807 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py' 2025-11-27T00:44:06,809 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti' 2025-11-27T00:44:06,810 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml' 2025-11-27T00:44:06,811 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml' 2025-11-27T00:44:06,812 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml' 2025-11-27T00:44:06,813 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml' 2025-11-27T00:44:06,815 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml' 2025-11-27T00:44:06,816 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml' 2025-11-27T00:44:06,817 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml' 2025-11-27T00:44:06,818 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml' 2025-11-27T00:44:06,819 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml' 2025-11-27T00:44:06,820 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml' 2025-11-27T00:44:06,821 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml' 2025-11-27T00:44:06,822 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml' 2025-11-27T00:44:06,824 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml' 2025-11-27T00:44:06,825 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml' 2025-11-27T00:44:06,826 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh' 2025-11-27T00:44:06,827 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py' 2025-11-27T00:44:06,828 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py' 2025-11-27T00:44:06,830 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti' 2025-11-27T00:44:06,831 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml' 2025-11-27T00:44:06,833 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml' 2025-11-27T00:44:06,834 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml' 2025-11-27T00:44:06,835 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml' 2025-11-27T00:44:06,836 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml' 2025-11-27T00:44:06,837 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml' 2025-11-27T00:44:06,839 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml' 2025-11-27T00:44:06,840 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml' 2025-11-27T00:44:06,841 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml' 2025-11-27T00:44:06,842 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml' 2025-11-27T00:44:06,843 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml' 2025-11-27T00:44:06,844 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml' 2025-11-27T00:44:06,845 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml' 2025-11-27T00:44:06,847 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml' 2025-11-27T00:44:06,848 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py' 2025-11-27T00:44:06,849 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py' 2025-11-27T00:44:06,850 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti' 2025-11-27T00:44:06,851 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml' 2025-11-27T00:44:06,852 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml' 2025-11-27T00:44:06,854 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml' 2025-11-27T00:44:06,855 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml' 2025-11-27T00:44:06,856 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml' 2025-11-27T00:44:06,857 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml' 2025-11-27T00:44:06,858 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml' 2025-11-27T00:44:06,859 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml' 2025-11-27T00:44:06,860 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml' 2025-11-27T00:44:06,861 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml' 2025-11-27T00:44:06,862 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml' 2025-11-27T00:44:06,863 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml' 2025-11-27T00:44:06,865 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml' 2025-11-27T00:44:06,866 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml' 2025-11-27T00:44:06,867 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py' 2025-11-27T00:44:06,868 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py' 2025-11-27T00:44:06,870 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti' 2025-11-27T00:44:06,871 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml' 2025-11-27T00:44:06,872 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml' 2025-11-27T00:44:06,873 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml' 2025-11-27T00:44:06,875 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml' 2025-11-27T00:44:06,876 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml' 2025-11-27T00:44:06,877 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml' 2025-11-27T00:44:06,878 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml' 2025-11-27T00:44:06,880 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml' 2025-11-27T00:44:06,881 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml' 2025-11-27T00:44:06,882 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml' 2025-11-27T00:44:06,883 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml' 2025-11-27T00:44:06,884 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml' 2025-11-27T00:44:06,886 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml' 2025-11-27T00:44:06,887 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml' 2025-11-27T00:44:06,888 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py' 2025-11-27T00:44:06,889 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py' 2025-11-27T00:44:06,891 adding 'lm_eval/tasks/afrobench/belebele/README.md' 2025-11-27T00:44:06,892 adding 'lm_eval/tasks/afrobench/belebele/belebele.yaml' 2025-11-27T00:44:06,894 adding 'lm_eval/tasks/afrobench/belebele/utils.py' 2025-11-27T00:44:06,896 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele' 2025-11-27T00:44:06,897 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml' 2025-11-27T00:44:06,898 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml' 2025-11-27T00:44:06,899 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml' 2025-11-27T00:44:06,900 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml' 2025-11-27T00:44:06,902 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml' 2025-11-27T00:44:06,903 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml' 2025-11-27T00:44:06,904 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml' 2025-11-27T00:44:06,905 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml' 2025-11-27T00:44:06,906 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml' 2025-11-27T00:44:06,907 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml' 2025-11-27T00:44:06,908 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml' 2025-11-27T00:44:06,909 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml' 2025-11-27T00:44:06,910 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml' 2025-11-27T00:44:06,911 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml' 2025-11-27T00:44:06,912 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml' 2025-11-27T00:44:06,914 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml' 2025-11-27T00:44:06,915 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml' 2025-11-27T00:44:06,916 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml' 2025-11-27T00:44:06,917 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml' 2025-11-27T00:44:06,918 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml' 2025-11-27T00:44:06,920 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml' 2025-11-27T00:44:06,921 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml' 2025-11-27T00:44:06,922 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml' 2025-11-27T00:44:06,923 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml' 2025-11-27T00:44:06,924 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml' 2025-11-27T00:44:06,925 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml' 2025-11-27T00:44:06,927 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml' 2025-11-27T00:44:06,928 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml' 2025-11-27T00:44:06,929 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml' 2025-11-27T00:44:06,930 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml' 2025-11-27T00:44:06,931 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml' 2025-11-27T00:44:06,933 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele' 2025-11-27T00:44:06,935 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml' 2025-11-27T00:44:06,936 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml' 2025-11-27T00:44:06,937 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml' 2025-11-27T00:44:06,938 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml' 2025-11-27T00:44:06,939 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml' 2025-11-27T00:44:06,940 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml' 2025-11-27T00:44:06,942 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml' 2025-11-27T00:44:06,943 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml' 2025-11-27T00:44:06,944 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml' 2025-11-27T00:44:06,945 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml' 2025-11-27T00:44:06,946 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml' 2025-11-27T00:44:06,948 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml' 2025-11-27T00:44:06,949 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml' 2025-11-27T00:44:06,950 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml' 2025-11-27T00:44:06,951 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml' 2025-11-27T00:44:06,952 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml' 2025-11-27T00:44:06,953 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml' 2025-11-27T00:44:06,954 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml' 2025-11-27T00:44:06,955 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml' 2025-11-27T00:44:06,956 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml' 2025-11-27T00:44:06,958 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml' 2025-11-27T00:44:06,959 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml' 2025-11-27T00:44:06,960 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml' 2025-11-27T00:44:06,961 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml' 2025-11-27T00:44:06,962 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml' 2025-11-27T00:44:06,963 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml' 2025-11-27T00:44:06,964 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml' 2025-11-27T00:44:06,966 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml' 2025-11-27T00:44:06,967 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml' 2025-11-27T00:44:06,968 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml' 2025-11-27T00:44:06,969 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml' 2025-11-27T00:44:06,971 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele' 2025-11-27T00:44:06,972 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml' 2025-11-27T00:44:06,974 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml' 2025-11-27T00:44:06,975 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml' 2025-11-27T00:44:06,976 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml' 2025-11-27T00:44:06,977 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml' 2025-11-27T00:44:06,978 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml' 2025-11-27T00:44:06,979 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml' 2025-11-27T00:44:06,981 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml' 2025-11-27T00:44:06,982 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml' 2025-11-27T00:44:06,983 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml' 2025-11-27T00:44:06,984 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml' 2025-11-27T00:44:06,985 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml' 2025-11-27T00:44:06,986 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml' 2025-11-27T00:44:06,988 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml' 2025-11-27T00:44:06,989 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml' 2025-11-27T00:44:06,990 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml' 2025-11-27T00:44:06,991 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml' 2025-11-27T00:44:06,992 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml' 2025-11-27T00:44:06,994 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml' 2025-11-27T00:44:06,995 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml' 2025-11-27T00:44:06,996 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml' 2025-11-27T00:44:06,997 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml' 2025-11-27T00:44:06,998 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml' 2025-11-27T00:44:06,999 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml' 2025-11-27T00:44:07,000 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml' 2025-11-27T00:44:07,001 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml' 2025-11-27T00:44:07,002 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml' 2025-11-27T00:44:07,003 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml' 2025-11-27T00:44:07,005 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml' 2025-11-27T00:44:07,006 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml' 2025-11-27T00:44:07,007 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml' 2025-11-27T00:44:07,009 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele' 2025-11-27T00:44:07,010 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml' 2025-11-27T00:44:07,011 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml' 2025-11-27T00:44:07,012 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml' 2025-11-27T00:44:07,013 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml' 2025-11-27T00:44:07,015 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml' 2025-11-27T00:44:07,016 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml' 2025-11-27T00:44:07,017 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml' 2025-11-27T00:44:07,018 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml' 2025-11-27T00:44:07,019 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml' 2025-11-27T00:44:07,020 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml' 2025-11-27T00:44:07,021 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml' 2025-11-27T00:44:07,022 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml' 2025-11-27T00:44:07,024 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml' 2025-11-27T00:44:07,025 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml' 2025-11-27T00:44:07,026 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml' 2025-11-27T00:44:07,027 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml' 2025-11-27T00:44:07,028 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml' 2025-11-27T00:44:07,029 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml' 2025-11-27T00:44:07,031 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml' 2025-11-27T00:44:07,032 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml' 2025-11-27T00:44:07,033 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml' 2025-11-27T00:44:07,034 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml' 2025-11-27T00:44:07,035 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml' 2025-11-27T00:44:07,036 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml' 2025-11-27T00:44:07,038 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml' 2025-11-27T00:44:07,039 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml' 2025-11-27T00:44:07,040 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml' 2025-11-27T00:44:07,041 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml' 2025-11-27T00:44:07,042 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml' 2025-11-27T00:44:07,044 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml' 2025-11-27T00:44:07,045 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml' 2025-11-27T00:44:07,047 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele' 2025-11-27T00:44:07,048 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml' 2025-11-27T00:44:07,049 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml' 2025-11-27T00:44:07,051 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml' 2025-11-27T00:44:07,052 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml' 2025-11-27T00:44:07,053 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml' 2025-11-27T00:44:07,054 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml' 2025-11-27T00:44:07,055 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml' 2025-11-27T00:44:07,056 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml' 2025-11-27T00:44:07,057 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml' 2025-11-27T00:44:07,058 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml' 2025-11-27T00:44:07,059 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml' 2025-11-27T00:44:07,060 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml' 2025-11-27T00:44:07,062 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml' 2025-11-27T00:44:07,063 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml' 2025-11-27T00:44:07,064 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml' 2025-11-27T00:44:07,065 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml' 2025-11-27T00:44:07,066 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml' 2025-11-27T00:44:07,067 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml' 2025-11-27T00:44:07,068 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml' 2025-11-27T00:44:07,070 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml' 2025-11-27T00:44:07,071 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml' 2025-11-27T00:44:07,072 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml' 2025-11-27T00:44:07,073 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml' 2025-11-27T00:44:07,074 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml' 2025-11-27T00:44:07,075 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml' 2025-11-27T00:44:07,076 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml' 2025-11-27T00:44:07,078 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml' 2025-11-27T00:44:07,079 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml' 2025-11-27T00:44:07,080 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml' 2025-11-27T00:44:07,081 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml' 2025-11-27T00:44:07,082 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml' 2025-11-27T00:44:07,084 adding 'lm_eval/tasks/afrobench/flores/README.md' 2025-11-27T00:44:07,085 adding 'lm_eval/tasks/afrobench/flores/flores.yaml' 2025-11-27T00:44:07,087 adding 'lm_eval/tasks/afrobench/flores/gen_utils.py' 2025-11-27T00:44:07,089 adding 'lm_eval/tasks/afrobench/flores/prompt_1/flores' 2025-11-27T00:44:07,092 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores' 2025-11-27T00:44:07,093 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,094 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,095 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,096 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,097 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,099 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,100 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,101 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,102 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,103 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,104 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,105 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,106 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,108 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,109 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,110 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,111 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,112 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,113 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,115 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,116 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,117 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,118 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,119 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,120 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,121 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,122 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,124 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,125 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,126 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,127 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,128 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,129 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,131 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,132 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,133 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,134 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,135 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,136 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,138 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,139 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,140 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,142 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,143 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,144 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,145 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,146 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,147 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,148 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,149 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,150 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,152 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,153 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,154 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,155 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,156 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,157 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,158 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,159 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,161 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,162 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,163 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,165 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores' 2025-11-27T00:44:07,167 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml' 2025-11-27T00:44:07,168 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml' 2025-11-27T00:44:07,169 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml' 2025-11-27T00:44:07,170 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml' 2025-11-27T00:44:07,171 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:07,172 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml' 2025-11-27T00:44:07,174 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:07,175 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml' 2025-11-27T00:44:07,176 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml' 2025-11-27T00:44:07,177 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml' 2025-11-27T00:44:07,178 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml' 2025-11-27T00:44:07,179 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:07,181 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml' 2025-11-27T00:44:07,182 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml' 2025-11-27T00:44:07,183 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml' 2025-11-27T00:44:07,184 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:07,185 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml' 2025-11-27T00:44:07,186 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:07,187 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml' 2025-11-27T00:44:07,188 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml' 2025-11-27T00:44:07,189 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:07,190 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:07,192 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml' 2025-11-27T00:44:07,193 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml' 2025-11-27T00:44:07,194 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml' 2025-11-27T00:44:07,195 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml' 2025-11-27T00:44:07,196 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml' 2025-11-27T00:44:07,197 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:07,198 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml' 2025-11-27T00:44:07,199 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml' 2025-11-27T00:44:07,201 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml' 2025-11-27T00:44:07,202 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml' 2025-11-27T00:44:07,203 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml' 2025-11-27T00:44:07,204 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml' 2025-11-27T00:44:07,205 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml' 2025-11-27T00:44:07,206 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml' 2025-11-27T00:44:07,207 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml' 2025-11-27T00:44:07,208 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:07,210 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml' 2025-11-27T00:44:07,211 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:07,212 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml' 2025-11-27T00:44:07,213 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml' 2025-11-27T00:44:07,214 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml' 2025-11-27T00:44:07,215 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:07,217 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:07,218 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml' 2025-11-27T00:44:07,219 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:07,220 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml' 2025-11-27T00:44:07,221 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml' 2025-11-27T00:44:07,222 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml' 2025-11-27T00:44:07,223 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml' 2025-11-27T00:44:07,224 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:07,225 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:07,226 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml' 2025-11-27T00:44:07,227 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml' 2025-11-27T00:44:07,228 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml' 2025-11-27T00:44:07,230 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2025-11-27T00:44:07,231 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml' 2025-11-27T00:44:07,232 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:07,233 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:07,234 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:07,235 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:07,237 adding 'lm_eval/tasks/afrobench/flores/prompt_2/flores' 2025-11-27T00:44:07,239 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores' 2025-11-27T00:44:07,240 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,242 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,243 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,244 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,245 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,246 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,247 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,249 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,250 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,251 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,252 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,253 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,254 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,256 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,257 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,258 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,259 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,260 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,261 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,262 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,263 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,264 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,266 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,267 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,268 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,269 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,270 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,271 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,272 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,273 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,274 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,275 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,277 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,278 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,279 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,280 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,281 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,282 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,284 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,285 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,286 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,287 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,288 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,289 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,290 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,292 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,293 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,294 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,295 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,296 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,298 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,299 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,300 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,301 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,302 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,303 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,304 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,305 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,306 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,307 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,309 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,310 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,313 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores' 2025-11-27T00:44:07,314 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml' 2025-11-27T00:44:07,315 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml' 2025-11-27T00:44:07,316 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml' 2025-11-27T00:44:07,317 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml' 2025-11-27T00:44:07,318 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:07,319 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml' 2025-11-27T00:44:07,321 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:07,322 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml' 2025-11-27T00:44:07,323 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml' 2025-11-27T00:44:07,324 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml' 2025-11-27T00:44:07,326 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml' 2025-11-27T00:44:07,327 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:07,328 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml' 2025-11-27T00:44:07,329 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml' 2025-11-27T00:44:07,330 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml' 2025-11-27T00:44:07,331 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:07,333 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml' 2025-11-27T00:44:07,334 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:07,335 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml' 2025-11-27T00:44:07,336 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml' 2025-11-27T00:44:07,337 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:07,338 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:07,340 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml' 2025-11-27T00:44:07,341 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml' 2025-11-27T00:44:07,342 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml' 2025-11-27T00:44:07,343 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml' 2025-11-27T00:44:07,344 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml' 2025-11-27T00:44:07,345 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:07,346 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml' 2025-11-27T00:44:07,347 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml' 2025-11-27T00:44:07,349 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml' 2025-11-27T00:44:07,350 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml' 2025-11-27T00:44:07,351 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml' 2025-11-27T00:44:07,352 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml' 2025-11-27T00:44:07,353 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml' 2025-11-27T00:44:07,354 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml' 2025-11-27T00:44:07,356 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml' 2025-11-27T00:44:07,357 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:07,358 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml' 2025-11-27T00:44:07,359 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:07,360 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml' 2025-11-27T00:44:07,362 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml' 2025-11-27T00:44:07,363 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml' 2025-11-27T00:44:07,364 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:07,365 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:07,366 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml' 2025-11-27T00:44:07,367 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:07,369 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml' 2025-11-27T00:44:07,370 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml' 2025-11-27T00:44:07,371 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml' 2025-11-27T00:44:07,372 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml' 2025-11-27T00:44:07,373 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:07,375 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:07,376 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml' 2025-11-27T00:44:07,377 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml' 2025-11-27T00:44:07,378 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml' 2025-11-27T00:44:07,380 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2025-11-27T00:44:07,381 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml' 2025-11-27T00:44:07,382 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:07,383 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:07,384 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:07,385 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:07,387 adding 'lm_eval/tasks/afrobench/flores/prompt_3/flores' 2025-11-27T00:44:07,389 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores' 2025-11-27T00:44:07,391 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,392 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,393 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,394 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,395 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,396 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,397 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,399 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,400 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,401 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,402 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,403 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,404 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,406 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,407 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,408 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,409 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,411 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,412 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,413 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,414 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,415 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,416 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,418 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,419 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,420 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,421 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,422 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,423 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,424 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml' 2025-11-27T00:44:07,425 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,426 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,428 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,429 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,430 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,431 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,432 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,433 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,434 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,435 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,436 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,438 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,439 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,440 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,441 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,442 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,443 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,444 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,446 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,447 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,448 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,449 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:07,450 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,451 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,453 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,454 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,455 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2025-11-27T00:44:07,456 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,457 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,458 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,460 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,461 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:07,463 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores' 2025-11-27T00:44:07,464 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml' 2025-11-27T00:44:07,465 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml' 2025-11-27T00:44:07,466 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml' 2025-11-27T00:44:07,467 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml' 2025-11-27T00:44:07,468 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:07,470 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml' 2025-11-27T00:44:07,471 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:07,472 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml' 2025-11-27T00:44:07,473 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml' 2025-11-27T00:44:07,474 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml' 2025-11-27T00:44:07,475 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml' 2025-11-27T00:44:07,476 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:07,477 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml' 2025-11-27T00:44:07,478 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml' 2025-11-27T00:44:07,479 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml' 2025-11-27T00:44:07,481 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:07,482 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml' 2025-11-27T00:44:07,483 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:07,484 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml' 2025-11-27T00:44:07,485 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml' 2025-11-27T00:44:07,486 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:07,487 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:07,488 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml' 2025-11-27T00:44:07,490 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml' 2025-11-27T00:44:07,491 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml' 2025-11-27T00:44:07,492 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml' 2025-11-27T00:44:07,493 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml' 2025-11-27T00:44:07,494 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:07,495 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml' 2025-11-27T00:44:07,497 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml' 2025-11-27T00:44:07,498 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml' 2025-11-27T00:44:07,499 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml' 2025-11-27T00:44:07,500 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml' 2025-11-27T00:44:07,501 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml' 2025-11-27T00:44:07,502 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml' 2025-11-27T00:44:07,503 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml' 2025-11-27T00:44:07,504 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml' 2025-11-27T00:44:07,505 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:07,506 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml' 2025-11-27T00:44:07,507 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:07,509 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml' 2025-11-27T00:44:07,510 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml' 2025-11-27T00:44:07,511 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml' 2025-11-27T00:44:07,512 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:07,513 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:07,514 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml' 2025-11-27T00:44:07,515 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:07,516 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml' 2025-11-27T00:44:07,518 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml' 2025-11-27T00:44:07,519 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml' 2025-11-27T00:44:07,520 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml' 2025-11-27T00:44:07,521 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:07,522 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:07,523 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml' 2025-11-27T00:44:07,524 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml' 2025-11-27T00:44:07,525 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml' 2025-11-27T00:44:07,527 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2025-11-27T00:44:07,528 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml' 2025-11-27T00:44:07,529 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:07,530 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:07,531 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:07,533 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:07,535 adding 'lm_eval/tasks/afrobench/injongointent/README.md' 2025-11-27T00:44:07,536 adding 'lm_eval/tasks/afrobench/injongointent/gen_utils.py' 2025-11-27T00:44:07,537 adding 'lm_eval/tasks/afrobench/injongointent/injongointent.yaml' 2025-11-27T00:44:07,539 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent' 2025-11-27T00:44:07,540 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml' 2025-11-27T00:44:07,542 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml' 2025-11-27T00:44:07,543 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml' 2025-11-27T00:44:07,544 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml' 2025-11-27T00:44:07,545 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml' 2025-11-27T00:44:07,546 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml' 2025-11-27T00:44:07,547 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml' 2025-11-27T00:44:07,549 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml' 2025-11-27T00:44:07,550 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml' 2025-11-27T00:44:07,551 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml' 2025-11-27T00:44:07,552 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml' 2025-11-27T00:44:07,553 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml' 2025-11-27T00:44:07,555 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml' 2025-11-27T00:44:07,556 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml' 2025-11-27T00:44:07,557 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml' 2025-11-27T00:44:07,558 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml' 2025-11-27T00:44:07,559 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml' 2025-11-27T00:44:07,561 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py' 2025-11-27T00:44:07,563 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent' 2025-11-27T00:44:07,564 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml' 2025-11-27T00:44:07,565 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml' 2025-11-27T00:44:07,566 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml' 2025-11-27T00:44:07,567 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml' 2025-11-27T00:44:07,569 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml' 2025-11-27T00:44:07,570 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml' 2025-11-27T00:44:07,571 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml' 2025-11-27T00:44:07,572 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml' 2025-11-27T00:44:07,574 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml' 2025-11-27T00:44:07,575 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml' 2025-11-27T00:44:07,576 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml' 2025-11-27T00:44:07,577 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml' 2025-11-27T00:44:07,578 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml' 2025-11-27T00:44:07,580 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml' 2025-11-27T00:44:07,581 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml' 2025-11-27T00:44:07,582 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml' 2025-11-27T00:44:07,583 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml' 2025-11-27T00:44:07,584 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py' 2025-11-27T00:44:07,586 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent' 2025-11-27T00:44:07,588 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml' 2025-11-27T00:44:07,589 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml' 2025-11-27T00:44:07,590 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml' 2025-11-27T00:44:07,591 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml' 2025-11-27T00:44:07,592 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml' 2025-11-27T00:44:07,593 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml' 2025-11-27T00:44:07,595 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml' 2025-11-27T00:44:07,596 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml' 2025-11-27T00:44:07,597 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml' 2025-11-27T00:44:07,598 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml' 2025-11-27T00:44:07,599 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml' 2025-11-27T00:44:07,601 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml' 2025-11-27T00:44:07,602 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml' 2025-11-27T00:44:07,603 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml' 2025-11-27T00:44:07,604 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml' 2025-11-27T00:44:07,605 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml' 2025-11-27T00:44:07,607 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml' 2025-11-27T00:44:07,608 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py' 2025-11-27T00:44:07,610 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent' 2025-11-27T00:44:07,611 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml' 2025-11-27T00:44:07,612 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml' 2025-11-27T00:44:07,613 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml' 2025-11-27T00:44:07,614 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml' 2025-11-27T00:44:07,616 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml' 2025-11-27T00:44:07,617 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml' 2025-11-27T00:44:07,618 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml' 2025-11-27T00:44:07,619 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml' 2025-11-27T00:44:07,621 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml' 2025-11-27T00:44:07,622 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml' 2025-11-27T00:44:07,623 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml' 2025-11-27T00:44:07,624 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml' 2025-11-27T00:44:07,625 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml' 2025-11-27T00:44:07,627 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml' 2025-11-27T00:44:07,628 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml' 2025-11-27T00:44:07,629 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml' 2025-11-27T00:44:07,630 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml' 2025-11-27T00:44:07,631 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py' 2025-11-27T00:44:07,633 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent' 2025-11-27T00:44:07,635 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml' 2025-11-27T00:44:07,636 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml' 2025-11-27T00:44:07,637 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml' 2025-11-27T00:44:07,638 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml' 2025-11-27T00:44:07,639 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml' 2025-11-27T00:44:07,640 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml' 2025-11-27T00:44:07,641 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml' 2025-11-27T00:44:07,643 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml' 2025-11-27T00:44:07,644 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml' 2025-11-27T00:44:07,645 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml' 2025-11-27T00:44:07,646 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml' 2025-11-27T00:44:07,647 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml' 2025-11-27T00:44:07,649 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml' 2025-11-27T00:44:07,650 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml' 2025-11-27T00:44:07,651 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml' 2025-11-27T00:44:07,652 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml' 2025-11-27T00:44:07,653 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml' 2025-11-27T00:44:07,655 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py' 2025-11-27T00:44:07,657 adding 'lm_eval/tasks/afrobench/mafand/README.md' 2025-11-27T00:44:07,658 adding 'lm_eval/tasks/afrobench/mafand/gen_utils.py' 2025-11-27T00:44:07,659 adding 'lm_eval/tasks/afrobench/mafand/mafand.yaml' 2025-11-27T00:44:07,662 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand' 2025-11-27T00:44:07,663 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml' 2025-11-27T00:44:07,664 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml' 2025-11-27T00:44:07,665 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml' 2025-11-27T00:44:07,666 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml' 2025-11-27T00:44:07,667 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml' 2025-11-27T00:44:07,668 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml' 2025-11-27T00:44:07,670 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml' 2025-11-27T00:44:07,671 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml' 2025-11-27T00:44:07,672 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml' 2025-11-27T00:44:07,673 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml' 2025-11-27T00:44:07,674 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml' 2025-11-27T00:44:07,675 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml' 2025-11-27T00:44:07,676 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml' 2025-11-27T00:44:07,677 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml' 2025-11-27T00:44:07,679 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml' 2025-11-27T00:44:07,680 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml' 2025-11-27T00:44:07,681 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml' 2025-11-27T00:44:07,682 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml' 2025-11-27T00:44:07,683 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml' 2025-11-27T00:44:07,684 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml' 2025-11-27T00:44:07,685 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml' 2025-11-27T00:44:07,687 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py' 2025-11-27T00:44:07,689 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand' 2025-11-27T00:44:07,690 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml' 2025-11-27T00:44:07,691 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml' 2025-11-27T00:44:07,692 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml' 2025-11-27T00:44:07,693 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml' 2025-11-27T00:44:07,694 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml' 2025-11-27T00:44:07,695 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml' 2025-11-27T00:44:07,696 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml' 2025-11-27T00:44:07,697 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml' 2025-11-27T00:44:07,698 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml' 2025-11-27T00:44:07,699 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml' 2025-11-27T00:44:07,700 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml' 2025-11-27T00:44:07,701 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml' 2025-11-27T00:44:07,702 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml' 2025-11-27T00:44:07,704 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml' 2025-11-27T00:44:07,705 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml' 2025-11-27T00:44:07,706 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml' 2025-11-27T00:44:07,707 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml' 2025-11-27T00:44:07,708 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml' 2025-11-27T00:44:07,709 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml' 2025-11-27T00:44:07,710 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml' 2025-11-27T00:44:07,711 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml' 2025-11-27T00:44:07,713 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py' 2025-11-27T00:44:07,715 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand' 2025-11-27T00:44:07,716 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml' 2025-11-27T00:44:07,717 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml' 2025-11-27T00:44:07,718 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml' 2025-11-27T00:44:07,720 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml' 2025-11-27T00:44:07,721 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml' 2025-11-27T00:44:07,722 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml' 2025-11-27T00:44:07,723 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml' 2025-11-27T00:44:07,724 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml' 2025-11-27T00:44:07,725 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml' 2025-11-27T00:44:07,726 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml' 2025-11-27T00:44:07,727 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml' 2025-11-27T00:44:07,729 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml' 2025-11-27T00:44:07,730 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml' 2025-11-27T00:44:07,731 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml' 2025-11-27T00:44:07,739 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml' 2025-11-27T00:44:07,740 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml' 2025-11-27T00:44:07,742 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml' 2025-11-27T00:44:07,743 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml' 2025-11-27T00:44:07,744 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml' 2025-11-27T00:44:07,745 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml' 2025-11-27T00:44:07,746 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml' 2025-11-27T00:44:07,747 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py' 2025-11-27T00:44:07,749 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand' 2025-11-27T00:44:07,750 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml' 2025-11-27T00:44:07,751 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml' 2025-11-27T00:44:07,752 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml' 2025-11-27T00:44:07,753 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml' 2025-11-27T00:44:07,754 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml' 2025-11-27T00:44:07,756 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml' 2025-11-27T00:44:07,757 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml' 2025-11-27T00:44:07,758 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml' 2025-11-27T00:44:07,759 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml' 2025-11-27T00:44:07,760 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml' 2025-11-27T00:44:07,761 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml' 2025-11-27T00:44:07,762 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml' 2025-11-27T00:44:07,763 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml' 2025-11-27T00:44:07,764 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml' 2025-11-27T00:44:07,766 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml' 2025-11-27T00:44:07,767 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml' 2025-11-27T00:44:07,768 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml' 2025-11-27T00:44:07,769 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml' 2025-11-27T00:44:07,770 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml' 2025-11-27T00:44:07,771 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml' 2025-11-27T00:44:07,772 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml' 2025-11-27T00:44:07,774 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py' 2025-11-27T00:44:07,776 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand' 2025-11-27T00:44:07,777 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml' 2025-11-27T00:44:07,779 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml' 2025-11-27T00:44:07,780 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml' 2025-11-27T00:44:07,781 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml' 2025-11-27T00:44:07,782 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml' 2025-11-27T00:44:07,783 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml' 2025-11-27T00:44:07,784 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml' 2025-11-27T00:44:07,785 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml' 2025-11-27T00:44:07,786 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml' 2025-11-27T00:44:07,787 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml' 2025-11-27T00:44:07,788 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml' 2025-11-27T00:44:07,789 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml' 2025-11-27T00:44:07,790 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml' 2025-11-27T00:44:07,791 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml' 2025-11-27T00:44:07,793 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml' 2025-11-27T00:44:07,794 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml' 2025-11-27T00:44:07,795 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml' 2025-11-27T00:44:07,796 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml' 2025-11-27T00:44:07,797 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml' 2025-11-27T00:44:07,798 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml' 2025-11-27T00:44:07,799 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml' 2025-11-27T00:44:07,801 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py' 2025-11-27T00:44:07,803 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand' 2025-11-27T00:44:07,804 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml' 2025-11-27T00:44:07,805 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml' 2025-11-27T00:44:07,806 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml' 2025-11-27T00:44:07,807 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml' 2025-11-27T00:44:07,808 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml' 2025-11-27T00:44:07,809 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml' 2025-11-27T00:44:07,810 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml' 2025-11-27T00:44:07,811 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml' 2025-11-27T00:44:07,813 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml' 2025-11-27T00:44:07,814 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml' 2025-11-27T00:44:07,815 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml' 2025-11-27T00:44:07,816 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml' 2025-11-27T00:44:07,817 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml' 2025-11-27T00:44:07,818 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml' 2025-11-27T00:44:07,819 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml' 2025-11-27T00:44:07,821 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml' 2025-11-27T00:44:07,822 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml' 2025-11-27T00:44:07,823 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml' 2025-11-27T00:44:07,824 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml' 2025-11-27T00:44:07,825 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml' 2025-11-27T00:44:07,826 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml' 2025-11-27T00:44:07,827 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py' 2025-11-27T00:44:07,829 adding 'lm_eval/tasks/afrobench/masakhaner/README.md' 2025-11-27T00:44:07,831 adding 'lm_eval/tasks/afrobench/masakhaner/gen_utils.py' 2025-11-27T00:44:07,832 adding 'lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml' 2025-11-27T00:44:07,834 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner' 2025-11-27T00:44:07,835 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml' 2025-11-27T00:44:07,836 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml' 2025-11-27T00:44:07,837 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml' 2025-11-27T00:44:07,839 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml' 2025-11-27T00:44:07,840 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml' 2025-11-27T00:44:07,841 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml' 2025-11-27T00:44:07,842 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml' 2025-11-27T00:44:07,843 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml' 2025-11-27T00:44:07,845 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml' 2025-11-27T00:44:07,846 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml' 2025-11-27T00:44:07,847 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml' 2025-11-27T00:44:07,848 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml' 2025-11-27T00:44:07,849 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml' 2025-11-27T00:44:07,851 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml' 2025-11-27T00:44:07,852 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml' 2025-11-27T00:44:07,853 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml' 2025-11-27T00:44:07,854 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml' 2025-11-27T00:44:07,855 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml' 2025-11-27T00:44:07,857 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml' 2025-11-27T00:44:07,858 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml' 2025-11-27T00:44:07,859 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py' 2025-11-27T00:44:07,861 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner' 2025-11-27T00:44:07,863 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml' 2025-11-27T00:44:07,864 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml' 2025-11-27T00:44:07,865 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml' 2025-11-27T00:44:07,866 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml' 2025-11-27T00:44:07,868 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml' 2025-11-27T00:44:07,869 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml' 2025-11-27T00:44:07,870 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml' 2025-11-27T00:44:07,871 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml' 2025-11-27T00:44:07,872 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml' 2025-11-27T00:44:07,874 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml' 2025-11-27T00:44:07,875 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml' 2025-11-27T00:44:07,876 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml' 2025-11-27T00:44:07,877 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml' 2025-11-27T00:44:07,878 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml' 2025-11-27T00:44:07,880 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml' 2025-11-27T00:44:07,881 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml' 2025-11-27T00:44:07,882 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml' 2025-11-27T00:44:07,883 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml' 2025-11-27T00:44:07,884 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml' 2025-11-27T00:44:07,885 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml' 2025-11-27T00:44:07,887 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py' 2025-11-27T00:44:07,888 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner' 2025-11-27T00:44:07,890 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml' 2025-11-27T00:44:07,891 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml' 2025-11-27T00:44:07,892 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml' 2025-11-27T00:44:07,893 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml' 2025-11-27T00:44:07,894 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml' 2025-11-27T00:44:07,895 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml' 2025-11-27T00:44:07,897 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml' 2025-11-27T00:44:07,898 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml' 2025-11-27T00:44:07,899 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml' 2025-11-27T00:44:07,900 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml' 2025-11-27T00:44:07,902 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml' 2025-11-27T00:44:07,903 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml' 2025-11-27T00:44:07,904 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml' 2025-11-27T00:44:07,905 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml' 2025-11-27T00:44:07,906 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml' 2025-11-27T00:44:07,907 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml' 2025-11-27T00:44:07,909 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml' 2025-11-27T00:44:07,910 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml' 2025-11-27T00:44:07,911 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml' 2025-11-27T00:44:07,912 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml' 2025-11-27T00:44:07,914 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py' 2025-11-27T00:44:07,916 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner' 2025-11-27T00:44:07,917 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml' 2025-11-27T00:44:07,918 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml' 2025-11-27T00:44:07,919 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml' 2025-11-27T00:44:07,920 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml' 2025-11-27T00:44:07,922 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml' 2025-11-27T00:44:07,923 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml' 2025-11-27T00:44:07,924 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml' 2025-11-27T00:44:07,925 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml' 2025-11-27T00:44:07,926 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml' 2025-11-27T00:44:07,927 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml' 2025-11-27T00:44:07,929 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml' 2025-11-27T00:44:07,930 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml' 2025-11-27T00:44:07,931 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml' 2025-11-27T00:44:07,932 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml' 2025-11-27T00:44:07,933 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml' 2025-11-27T00:44:07,934 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml' 2025-11-27T00:44:07,935 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml' 2025-11-27T00:44:07,936 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml' 2025-11-27T00:44:07,937 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml' 2025-11-27T00:44:07,938 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml' 2025-11-27T00:44:07,940 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py' 2025-11-27T00:44:07,942 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner' 2025-11-27T00:44:07,943 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml' 2025-11-27T00:44:07,944 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml' 2025-11-27T00:44:07,945 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml' 2025-11-27T00:44:07,946 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml' 2025-11-27T00:44:07,947 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml' 2025-11-27T00:44:07,948 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml' 2025-11-27T00:44:07,950 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml' 2025-11-27T00:44:07,951 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml' 2025-11-27T00:44:07,952 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml' 2025-11-27T00:44:07,953 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml' 2025-11-27T00:44:07,954 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml' 2025-11-27T00:44:07,956 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml' 2025-11-27T00:44:07,957 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml' 2025-11-27T00:44:07,958 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml' 2025-11-27T00:44:07,959 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml' 2025-11-27T00:44:07,960 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml' 2025-11-27T00:44:07,961 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml' 2025-11-27T00:44:07,963 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml' 2025-11-27T00:44:07,964 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml' 2025-11-27T00:44:07,965 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml' 2025-11-27T00:44:07,967 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py' 2025-11-27T00:44:07,969 adding 'lm_eval/tasks/afrobench/masakhanews/README.md' 2025-11-27T00:44:07,970 adding 'lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml' 2025-11-27T00:44:07,971 adding 'lm_eval/tasks/afrobench/masakhanews/utils.py' 2025-11-27T00:44:07,973 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews' 2025-11-27T00:44:07,974 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml' 2025-11-27T00:44:07,976 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml' 2025-11-27T00:44:07,977 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml' 2025-11-27T00:44:07,978 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml' 2025-11-27T00:44:07,979 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml' 2025-11-27T00:44:07,980 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml' 2025-11-27T00:44:07,981 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml' 2025-11-27T00:44:07,982 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml' 2025-11-27T00:44:07,983 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml' 2025-11-27T00:44:07,984 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml' 2025-11-27T00:44:07,985 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml' 2025-11-27T00:44:07,986 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml' 2025-11-27T00:44:07,987 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml' 2025-11-27T00:44:07,989 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml' 2025-11-27T00:44:07,990 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml' 2025-11-27T00:44:07,991 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml' 2025-11-27T00:44:07,992 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py' 2025-11-27T00:44:07,994 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews' 2025-11-27T00:44:07,995 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml' 2025-11-27T00:44:07,996 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml' 2025-11-27T00:44:07,997 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml' 2025-11-27T00:44:07,998 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml' 2025-11-27T00:44:07,999 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml' 2025-11-27T00:44:08,001 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml' 2025-11-27T00:44:08,002 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml' 2025-11-27T00:44:08,003 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml' 2025-11-27T00:44:08,004 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml' 2025-11-27T00:44:08,005 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml' 2025-11-27T00:44:08,006 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml' 2025-11-27T00:44:08,007 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml' 2025-11-27T00:44:08,009 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml' 2025-11-27T00:44:08,010 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml' 2025-11-27T00:44:08,011 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml' 2025-11-27T00:44:08,012 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml' 2025-11-27T00:44:08,013 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py' 2025-11-27T00:44:08,015 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews' 2025-11-27T00:44:08,016 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml' 2025-11-27T00:44:08,017 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml' 2025-11-27T00:44:08,019 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml' 2025-11-27T00:44:08,020 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml' 2025-11-27T00:44:08,021 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml' 2025-11-27T00:44:08,022 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml' 2025-11-27T00:44:08,023 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml' 2025-11-27T00:44:08,025 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml' 2025-11-27T00:44:08,026 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml' 2025-11-27T00:44:08,027 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml' 2025-11-27T00:44:08,028 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml' 2025-11-27T00:44:08,029 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml' 2025-11-27T00:44:08,030 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml' 2025-11-27T00:44:08,031 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml' 2025-11-27T00:44:08,032 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml' 2025-11-27T00:44:08,033 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml' 2025-11-27T00:44:08,034 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py' 2025-11-27T00:44:08,036 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews' 2025-11-27T00:44:08,037 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml' 2025-11-27T00:44:08,038 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml' 2025-11-27T00:44:08,039 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml' 2025-11-27T00:44:08,041 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml' 2025-11-27T00:44:08,042 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml' 2025-11-27T00:44:08,043 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml' 2025-11-27T00:44:08,044 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml' 2025-11-27T00:44:08,045 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml' 2025-11-27T00:44:08,046 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml' 2025-11-27T00:44:08,047 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml' 2025-11-27T00:44:08,049 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml' 2025-11-27T00:44:08,050 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml' 2025-11-27T00:44:08,078 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml' 2025-11-27T00:44:08,079 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml' 2025-11-27T00:44:08,080 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml' 2025-11-27T00:44:08,081 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml' 2025-11-27T00:44:08,082 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py' 2025-11-27T00:44:08,084 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews' 2025-11-27T00:44:08,086 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml' 2025-11-27T00:44:08,087 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml' 2025-11-27T00:44:08,088 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml' 2025-11-27T00:44:08,089 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml' 2025-11-27T00:44:08,091 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml' 2025-11-27T00:44:08,092 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml' 2025-11-27T00:44:08,093 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml' 2025-11-27T00:44:08,094 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml' 2025-11-27T00:44:08,096 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml' 2025-11-27T00:44:08,097 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml' 2025-11-27T00:44:08,098 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml' 2025-11-27T00:44:08,099 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml' 2025-11-27T00:44:08,101 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml' 2025-11-27T00:44:08,102 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml' 2025-11-27T00:44:08,103 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml' 2025-11-27T00:44:08,104 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml' 2025-11-27T00:44:08,105 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py' 2025-11-27T00:44:08,107 adding 'lm_eval/tasks/afrobench/masakhapos/README.md' 2025-11-27T00:44:08,109 adding 'lm_eval/tasks/afrobench/masakhapos/gen_utils.py' 2025-11-27T00:44:08,110 adding 'lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml' 2025-11-27T00:44:08,111 adding 'lm_eval/tasks/afrobench/masakhapos/utils.py' 2025-11-27T00:44:08,113 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml' 2025-11-27T00:44:08,114 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml' 2025-11-27T00:44:08,116 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml' 2025-11-27T00:44:08,117 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml' 2025-11-27T00:44:08,119 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml' 2025-11-27T00:44:08,120 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml' 2025-11-27T00:44:08,121 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml' 2025-11-27T00:44:08,122 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml' 2025-11-27T00:44:08,124 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml' 2025-11-27T00:44:08,125 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml' 2025-11-27T00:44:08,126 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml' 2025-11-27T00:44:08,127 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml' 2025-11-27T00:44:08,128 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml' 2025-11-27T00:44:08,130 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml' 2025-11-27T00:44:08,131 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml' 2025-11-27T00:44:08,132 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml' 2025-11-27T00:44:08,133 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml' 2025-11-27T00:44:08,134 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml' 2025-11-27T00:44:08,136 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml' 2025-11-27T00:44:08,137 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml' 2025-11-27T00:44:08,138 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml' 2025-11-27T00:44:08,139 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py' 2025-11-27T00:44:08,141 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml' 2025-11-27T00:44:08,142 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml' 2025-11-27T00:44:08,144 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml' 2025-11-27T00:44:08,145 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml' 2025-11-27T00:44:08,146 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml' 2025-11-27T00:44:08,148 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml' 2025-11-27T00:44:08,149 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml' 2025-11-27T00:44:08,150 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml' 2025-11-27T00:44:08,151 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml' 2025-11-27T00:44:08,153 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml' 2025-11-27T00:44:08,154 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml' 2025-11-27T00:44:08,155 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml' 2025-11-27T00:44:08,156 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml' 2025-11-27T00:44:08,157 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml' 2025-11-27T00:44:08,159 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml' 2025-11-27T00:44:08,160 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml' 2025-11-27T00:44:08,161 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml' 2025-11-27T00:44:08,162 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml' 2025-11-27T00:44:08,163 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml' 2025-11-27T00:44:08,164 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml' 2025-11-27T00:44:08,165 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml' 2025-11-27T00:44:08,167 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py' 2025-11-27T00:44:08,169 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml' 2025-11-27T00:44:08,170 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml' 2025-11-27T00:44:08,171 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml' 2025-11-27T00:44:08,172 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml' 2025-11-27T00:44:08,173 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml' 2025-11-27T00:44:08,175 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml' 2025-11-27T00:44:08,176 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml' 2025-11-27T00:44:08,177 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml' 2025-11-27T00:44:08,178 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml' 2025-11-27T00:44:08,179 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml' 2025-11-27T00:44:08,180 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml' 2025-11-27T00:44:08,182 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml' 2025-11-27T00:44:08,183 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml' 2025-11-27T00:44:08,184 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml' 2025-11-27T00:44:08,185 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml' 2025-11-27T00:44:08,186 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml' 2025-11-27T00:44:08,188 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml' 2025-11-27T00:44:08,189 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml' 2025-11-27T00:44:08,190 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml' 2025-11-27T00:44:08,191 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml' 2025-11-27T00:44:08,193 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml' 2025-11-27T00:44:08,194 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py' 2025-11-27T00:44:08,196 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml' 2025-11-27T00:44:08,197 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml' 2025-11-27T00:44:08,198 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml' 2025-11-27T00:44:08,200 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml' 2025-11-27T00:44:08,201 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml' 2025-11-27T00:44:08,202 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml' 2025-11-27T00:44:08,203 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml' 2025-11-27T00:44:08,204 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml' 2025-11-27T00:44:08,206 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml' 2025-11-27T00:44:08,207 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml' 2025-11-27T00:44:08,208 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml' 2025-11-27T00:44:08,209 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml' 2025-11-27T00:44:08,210 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml' 2025-11-27T00:44:08,212 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml' 2025-11-27T00:44:08,213 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml' 2025-11-27T00:44:08,214 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml' 2025-11-27T00:44:08,215 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml' 2025-11-27T00:44:08,216 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml' 2025-11-27T00:44:08,217 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml' 2025-11-27T00:44:08,218 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml' 2025-11-27T00:44:08,219 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml' 2025-11-27T00:44:08,220 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py' 2025-11-27T00:44:08,222 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml' 2025-11-27T00:44:08,223 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml' 2025-11-27T00:44:08,225 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml' 2025-11-27T00:44:08,226 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml' 2025-11-27T00:44:08,227 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml' 2025-11-27T00:44:08,228 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml' 2025-11-27T00:44:08,229 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml' 2025-11-27T00:44:08,231 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml' 2025-11-27T00:44:08,232 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml' 2025-11-27T00:44:08,233 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml' 2025-11-27T00:44:08,234 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml' 2025-11-27T00:44:08,236 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml' 2025-11-27T00:44:08,237 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml' 2025-11-27T00:44:08,238 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml' 2025-11-27T00:44:08,239 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml' 2025-11-27T00:44:08,241 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml' 2025-11-27T00:44:08,242 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml' 2025-11-27T00:44:08,243 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml' 2025-11-27T00:44:08,244 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml' 2025-11-27T00:44:08,246 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml' 2025-11-27T00:44:08,247 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml' 2025-11-27T00:44:08,248 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py' 2025-11-27T00:44:08,250 adding 'lm_eval/tasks/afrobench/naijarc/README.md' 2025-11-27T00:44:08,251 adding 'lm_eval/tasks/afrobench/naijarc/naijarc.yaml' 2025-11-27T00:44:08,253 adding 'lm_eval/tasks/afrobench/naijarc/utils.py' 2025-11-27T00:44:08,254 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc' 2025-11-27T00:44:08,255 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml' 2025-11-27T00:44:08,257 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml' 2025-11-27T00:44:08,258 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml' 2025-11-27T00:44:08,259 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc' 2025-11-27T00:44:08,261 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml' 2025-11-27T00:44:08,262 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml' 2025-11-27T00:44:08,263 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml' 2025-11-27T00:44:08,265 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc' 2025-11-27T00:44:08,266 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml' 2025-11-27T00:44:08,267 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml' 2025-11-27T00:44:08,268 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml' 2025-11-27T00:44:08,269 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc' 2025-11-27T00:44:08,270 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml' 2025-11-27T00:44:08,271 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml' 2025-11-27T00:44:08,272 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml' 2025-11-27T00:44:08,274 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc' 2025-11-27T00:44:08,275 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml' 2025-11-27T00:44:08,276 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml' 2025-11-27T00:44:08,277 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml' 2025-11-27T00:44:08,279 adding 'lm_eval/tasks/afrobench/nollysenti/README.md' 2025-11-27T00:44:08,280 adding 'lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml' 2025-11-27T00:44:08,282 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti' 2025-11-27T00:44:08,283 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml' 2025-11-27T00:44:08,284 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml' 2025-11-27T00:44:08,285 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml' 2025-11-27T00:44:08,286 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml' 2025-11-27T00:44:08,287 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml' 2025-11-27T00:44:08,288 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py' 2025-11-27T00:44:08,290 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti' 2025-11-27T00:44:08,291 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml' 2025-11-27T00:44:08,292 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml' 2025-11-27T00:44:08,293 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml' 2025-11-27T00:44:08,295 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml' 2025-11-27T00:44:08,296 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml' 2025-11-27T00:44:08,297 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py' 2025-11-27T00:44:08,299 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti' 2025-11-27T00:44:08,300 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml' 2025-11-27T00:44:08,301 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml' 2025-11-27T00:44:08,302 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml' 2025-11-27T00:44:08,303 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml' 2025-11-27T00:44:08,304 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml' 2025-11-27T00:44:08,306 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py' 2025-11-27T00:44:08,307 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti' 2025-11-27T00:44:08,309 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml' 2025-11-27T00:44:08,310 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml' 2025-11-27T00:44:08,311 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml' 2025-11-27T00:44:08,312 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml' 2025-11-27T00:44:08,313 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml' 2025-11-27T00:44:08,314 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py' 2025-11-27T00:44:08,316 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti' 2025-11-27T00:44:08,317 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml' 2025-11-27T00:44:08,318 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml' 2025-11-27T00:44:08,320 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml' 2025-11-27T00:44:08,321 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml' 2025-11-27T00:44:08,322 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml' 2025-11-27T00:44:08,323 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py' 2025-11-27T00:44:08,324 adding 'lm_eval/tasks/afrobench/ntrex/README.md' 2025-11-27T00:44:08,326 adding 'lm_eval/tasks/afrobench/ntrex/gen_utils.py' 2025-11-27T00:44:08,327 adding 'lm_eval/tasks/afrobench/ntrex/ntrex.yaml' 2025-11-27T00:44:08,329 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex' 2025-11-27T00:44:08,331 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,332 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,333 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,334 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,335 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,336 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,337 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,339 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,340 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,341 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,342 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,343 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,344 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,345 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,347 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,348 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,349 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,350 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,351 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,352 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,353 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,355 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2025-11-27T00:44:08,356 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2025-11-27T00:44:08,357 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,358 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,360 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,361 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,362 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,363 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,364 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,365 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,366 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,368 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex' 2025-11-27T00:44:08,369 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:08,370 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:08,371 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2025-11-27T00:44:08,373 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:08,374 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:08,375 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:08,376 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:08,377 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:08,378 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:08,379 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2025-11-27T00:44:08,380 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2025-11-27T00:44:08,381 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2025-11-27T00:44:08,383 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2025-11-27T00:44:08,384 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:08,385 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:08,386 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2025-11-27T00:44:08,387 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2025-11-27T00:44:08,388 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:08,389 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:08,391 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:08,392 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2025-11-27T00:44:08,393 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2025-11-27T00:44:08,394 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2025-11-27T00:44:08,395 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:08,396 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2025-11-27T00:44:08,397 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:08,399 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2025-11-27T00:44:08,400 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2025-11-27T00:44:08,401 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:08,402 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:08,403 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:08,404 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:08,407 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex' 2025-11-27T00:44:08,408 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,409 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,410 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,411 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,412 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,413 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,414 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,415 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,416 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,418 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,419 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,420 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,421 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,422 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,423 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,424 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,426 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,427 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,428 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,429 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,430 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,431 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2025-11-27T00:44:08,432 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2025-11-27T00:44:08,434 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,435 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,436 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,437 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,438 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,440 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,441 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,442 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,443 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,445 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex' 2025-11-27T00:44:08,446 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:08,447 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:08,448 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2025-11-27T00:44:08,449 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:08,450 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:08,451 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:08,453 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:08,454 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:08,455 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:08,456 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2025-11-27T00:44:08,457 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2025-11-27T00:44:08,458 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2025-11-27T00:44:08,459 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2025-11-27T00:44:08,460 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:08,462 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:08,463 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2025-11-27T00:44:08,464 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2025-11-27T00:44:08,465 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:08,466 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:08,467 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:08,468 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2025-11-27T00:44:08,470 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2025-11-27T00:44:08,471 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2025-11-27T00:44:08,472 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:08,473 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2025-11-27T00:44:08,474 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:08,475 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2025-11-27T00:44:08,476 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2025-11-27T00:44:08,478 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:08,479 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:08,480 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:08,481 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:08,484 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex' 2025-11-27T00:44:08,485 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,486 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,487 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,488 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,489 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,490 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,491 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,492 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,493 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,495 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,496 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,497 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,498 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,499 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,500 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,501 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,502 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,504 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,505 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,506 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,507 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,508 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2025-11-27T00:44:08,509 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2025-11-27T00:44:08,511 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2025-11-27T00:44:08,512 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,513 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,514 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2025-11-27T00:44:08,515 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,516 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,518 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,519 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,520 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2025-11-27T00:44:08,522 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex' 2025-11-27T00:44:08,523 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2025-11-27T00:44:08,524 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2025-11-27T00:44:08,526 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2025-11-27T00:44:08,527 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2025-11-27T00:44:08,528 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2025-11-27T00:44:08,529 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2025-11-27T00:44:08,530 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2025-11-27T00:44:08,531 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2025-11-27T00:44:08,532 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2025-11-27T00:44:08,533 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2025-11-27T00:44:08,534 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2025-11-27T00:44:08,536 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2025-11-27T00:44:08,537 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2025-11-27T00:44:08,538 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2025-11-27T00:44:08,539 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2025-11-27T00:44:08,540 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2025-11-27T00:44:08,541 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2025-11-27T00:44:08,542 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2025-11-27T00:44:08,544 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml' 2025-11-27T00:44:08,545 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2025-11-27T00:44:08,546 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2025-11-27T00:44:08,547 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2025-11-27T00:44:08,548 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2025-11-27T00:44:08,549 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2025-11-27T00:44:08,551 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2025-11-27T00:44:08,552 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2025-11-27T00:44:08,553 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2025-11-27T00:44:08,554 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2025-11-27T00:44:08,555 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2025-11-27T00:44:08,556 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2025-11-27T00:44:08,557 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2025-11-27T00:44:08,559 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2025-11-27T00:44:08,560 adding 'lm_eval/tasks/afrobench/openai_mmlu/README.md' 2025-11-27T00:44:08,562 adding 'lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml' 2025-11-27T00:44:08,563 adding 'lm_eval/tasks/afrobench/openai_mmlu/utils.py' 2025-11-27T00:44:08,565 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu' 2025-11-27T00:44:08,566 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml' 2025-11-27T00:44:08,567 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml' 2025-11-27T00:44:08,568 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml' 2025-11-27T00:44:08,572 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu' 2025-11-27T00:44:08,573 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml' 2025-11-27T00:44:08,574 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml' 2025-11-27T00:44:08,575 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml' 2025-11-27T00:44:08,577 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu' 2025-11-27T00:44:08,578 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml' 2025-11-27T00:44:08,579 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml' 2025-11-27T00:44:08,580 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml' 2025-11-27T00:44:08,582 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu' 2025-11-27T00:44:08,583 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml' 2025-11-27T00:44:08,584 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml' 2025-11-27T00:44:08,585 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml' 2025-11-27T00:44:08,587 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu' 2025-11-27T00:44:08,588 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml' 2025-11-27T00:44:08,589 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml' 2025-11-27T00:44:08,590 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml' 2025-11-27T00:44:08,592 adding 'lm_eval/tasks/afrobench/salt/README.md' 2025-11-27T00:44:08,593 adding 'lm_eval/tasks/afrobench/salt/gen_utils.py' 2025-11-27T00:44:08,594 adding 'lm_eval/tasks/afrobench/salt/salt.yaml' 2025-11-27T00:44:08,596 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt' 2025-11-27T00:44:08,597 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml' 2025-11-27T00:44:08,598 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml' 2025-11-27T00:44:08,599 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml' 2025-11-27T00:44:08,601 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml' 2025-11-27T00:44:08,602 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml' 2025-11-27T00:44:08,603 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml' 2025-11-27T00:44:08,604 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml' 2025-11-27T00:44:08,605 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml' 2025-11-27T00:44:08,606 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml' 2025-11-27T00:44:08,607 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml' 2025-11-27T00:44:08,609 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml' 2025-11-27T00:44:08,610 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml' 2025-11-27T00:44:08,611 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml' 2025-11-27T00:44:08,612 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml' 2025-11-27T00:44:08,614 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt' 2025-11-27T00:44:08,615 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml' 2025-11-27T00:44:08,616 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml' 2025-11-27T00:44:08,617 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml' 2025-11-27T00:44:08,619 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml' 2025-11-27T00:44:08,620 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml' 2025-11-27T00:44:08,621 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml' 2025-11-27T00:44:08,622 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml' 2025-11-27T00:44:08,623 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml' 2025-11-27T00:44:08,624 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml' 2025-11-27T00:44:08,626 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml' 2025-11-27T00:44:08,627 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml' 2025-11-27T00:44:08,628 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml' 2025-11-27T00:44:08,629 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml' 2025-11-27T00:44:08,630 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml' 2025-11-27T00:44:08,632 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt' 2025-11-27T00:44:08,633 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml' 2025-11-27T00:44:08,634 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml' 2025-11-27T00:44:08,635 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml' 2025-11-27T00:44:08,637 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml' 2025-11-27T00:44:08,638 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml' 2025-11-27T00:44:08,639 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml' 2025-11-27T00:44:08,640 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml' 2025-11-27T00:44:08,641 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml' 2025-11-27T00:44:08,642 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml' 2025-11-27T00:44:08,643 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml' 2025-11-27T00:44:08,645 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml' 2025-11-27T00:44:08,646 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml' 2025-11-27T00:44:08,647 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml' 2025-11-27T00:44:08,648 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml' 2025-11-27T00:44:08,650 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh' 2025-11-27T00:44:08,651 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh' 2025-11-27T00:44:08,653 adding 'lm_eval/tasks/afrobench/sib/README.md' 2025-11-27T00:44:08,654 adding 'lm_eval/tasks/afrobench/sib/sib.yaml' 2025-11-27T00:44:08,656 adding 'lm_eval/tasks/afrobench/sib/utils.py' 2025-11-27T00:44:08,659 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib' 2025-11-27T00:44:08,660 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml' 2025-11-27T00:44:08,661 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml' 2025-11-27T00:44:08,662 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml' 2025-11-27T00:44:08,663 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml' 2025-11-27T00:44:08,664 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml' 2025-11-27T00:44:08,666 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml' 2025-11-27T00:44:08,667 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml' 2025-11-27T00:44:08,668 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml' 2025-11-27T00:44:08,669 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml' 2025-11-27T00:44:08,670 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml' 2025-11-27T00:44:08,671 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml' 2025-11-27T00:44:08,673 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml' 2025-11-27T00:44:08,674 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml' 2025-11-27T00:44:08,675 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml' 2025-11-27T00:44:08,676 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml' 2025-11-27T00:44:08,677 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml' 2025-11-27T00:44:08,679 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml' 2025-11-27T00:44:08,680 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml' 2025-11-27T00:44:08,681 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml' 2025-11-27T00:44:08,682 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml' 2025-11-27T00:44:08,683 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml' 2025-11-27T00:44:08,684 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml' 2025-11-27T00:44:08,685 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml' 2025-11-27T00:44:08,686 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml' 2025-11-27T00:44:08,687 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml' 2025-11-27T00:44:08,688 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml' 2025-11-27T00:44:08,690 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml' 2025-11-27T00:44:08,691 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml' 2025-11-27T00:44:08,692 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml' 2025-11-27T00:44:08,693 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml' 2025-11-27T00:44:08,694 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml' 2025-11-27T00:44:08,695 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml' 2025-11-27T00:44:08,697 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml' 2025-11-27T00:44:08,698 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml' 2025-11-27T00:44:08,699 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml' 2025-11-27T00:44:08,700 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml' 2025-11-27T00:44:08,701 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml' 2025-11-27T00:44:08,702 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml' 2025-11-27T00:44:08,703 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml' 2025-11-27T00:44:08,705 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml' 2025-11-27T00:44:08,706 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml' 2025-11-27T00:44:08,707 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml' 2025-11-27T00:44:08,708 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml' 2025-11-27T00:44:08,709 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml' 2025-11-27T00:44:08,711 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml' 2025-11-27T00:44:08,712 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml' 2025-11-27T00:44:08,713 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml' 2025-11-27T00:44:08,714 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml' 2025-11-27T00:44:08,715 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml' 2025-11-27T00:44:08,716 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml' 2025-11-27T00:44:08,718 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml' 2025-11-27T00:44:08,719 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml' 2025-11-27T00:44:08,720 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml' 2025-11-27T00:44:08,721 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml' 2025-11-27T00:44:08,723 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml' 2025-11-27T00:44:08,724 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml' 2025-11-27T00:44:08,725 adding 'lm_eval/tasks/afrobench/sib/prompt_1/utils.py' 2025-11-27T00:44:08,728 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib' 2025-11-27T00:44:08,729 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml' 2025-11-27T00:44:08,730 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml' 2025-11-27T00:44:08,731 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml' 2025-11-27T00:44:08,732 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml' 2025-11-27T00:44:08,734 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml' 2025-11-27T00:44:08,735 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml' 2025-11-27T00:44:08,736 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml' 2025-11-27T00:44:08,737 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml' 2025-11-27T00:44:08,739 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml' 2025-11-27T00:44:08,740 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml' 2025-11-27T00:44:08,741 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml' 2025-11-27T00:44:08,742 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml' 2025-11-27T00:44:08,743 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml' 2025-11-27T00:44:08,744 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml' 2025-11-27T00:44:08,745 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml' 2025-11-27T00:44:08,746 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml' 2025-11-27T00:44:08,748 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml' 2025-11-27T00:44:08,749 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml' 2025-11-27T00:44:08,750 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml' 2025-11-27T00:44:08,751 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml' 2025-11-27T00:44:08,752 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml' 2025-11-27T00:44:08,753 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml' 2025-11-27T00:44:08,754 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml' 2025-11-27T00:44:08,756 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml' 2025-11-27T00:44:08,757 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml' 2025-11-27T00:44:08,758 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml' 2025-11-27T00:44:08,759 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml' 2025-11-27T00:44:08,760 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml' 2025-11-27T00:44:08,761 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml' 2025-11-27T00:44:08,763 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml' 2025-11-27T00:44:08,764 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml' 2025-11-27T00:44:08,765 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml' 2025-11-27T00:44:08,767 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml' 2025-11-27T00:44:08,768 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml' 2025-11-27T00:44:08,769 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml' 2025-11-27T00:44:08,770 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml' 2025-11-27T00:44:08,771 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml' 2025-11-27T00:44:08,773 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml' 2025-11-27T00:44:08,774 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml' 2025-11-27T00:44:08,775 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml' 2025-11-27T00:44:08,776 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml' 2025-11-27T00:44:08,777 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml' 2025-11-27T00:44:08,778 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml' 2025-11-27T00:44:08,780 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml' 2025-11-27T00:44:08,781 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml' 2025-11-27T00:44:08,782 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml' 2025-11-27T00:44:08,783 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml' 2025-11-27T00:44:08,785 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml' 2025-11-27T00:44:08,786 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml' 2025-11-27T00:44:08,787 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml' 2025-11-27T00:44:08,788 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml' 2025-11-27T00:44:08,789 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml' 2025-11-27T00:44:08,790 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml' 2025-11-27T00:44:08,792 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml' 2025-11-27T00:44:08,793 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml' 2025-11-27T00:44:08,794 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml' 2025-11-27T00:44:08,795 adding 'lm_eval/tasks/afrobench/sib/prompt_2/utils.py' 2025-11-27T00:44:08,798 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib' 2025-11-27T00:44:08,799 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml' 2025-11-27T00:44:08,800 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml' 2025-11-27T00:44:08,801 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml' 2025-11-27T00:44:08,802 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml' 2025-11-27T00:44:08,803 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml' 2025-11-27T00:44:08,804 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml' 2025-11-27T00:44:08,805 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml' 2025-11-27T00:44:08,807 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml' 2025-11-27T00:44:08,808 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml' 2025-11-27T00:44:08,809 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml' 2025-11-27T00:44:08,810 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml' 2025-11-27T00:44:08,811 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml' 2025-11-27T00:44:08,813 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml' 2025-11-27T00:44:08,814 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml' 2025-11-27T00:44:08,815 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml' 2025-11-27T00:44:08,816 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml' 2025-11-27T00:44:08,817 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml' 2025-11-27T00:44:08,818 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml' 2025-11-27T00:44:08,820 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml' 2025-11-27T00:44:08,821 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml' 2025-11-27T00:44:08,822 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml' 2025-11-27T00:44:08,823 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml' 2025-11-27T00:44:08,824 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml' 2025-11-27T00:44:08,825 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml' 2025-11-27T00:44:08,826 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml' 2025-11-27T00:44:08,828 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml' 2025-11-27T00:44:08,829 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml' 2025-11-27T00:44:08,830 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml' 2025-11-27T00:44:08,831 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml' 2025-11-27T00:44:08,832 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml' 2025-11-27T00:44:08,833 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml' 2025-11-27T00:44:08,835 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml' 2025-11-27T00:44:08,836 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml' 2025-11-27T00:44:08,837 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml' 2025-11-27T00:44:08,838 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml' 2025-11-27T00:44:08,839 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml' 2025-11-27T00:44:08,841 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml' 2025-11-27T00:44:08,842 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml' 2025-11-27T00:44:08,843 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml' 2025-11-27T00:44:08,844 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml' 2025-11-27T00:44:08,845 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml' 2025-11-27T00:44:08,847 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml' 2025-11-27T00:44:08,848 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml' 2025-11-27T00:44:08,849 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml' 2025-11-27T00:44:08,850 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml' 2025-11-27T00:44:08,851 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml' 2025-11-27T00:44:08,853 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml' 2025-11-27T00:44:08,854 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml' 2025-11-27T00:44:08,855 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml' 2025-11-27T00:44:08,856 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml' 2025-11-27T00:44:08,857 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml' 2025-11-27T00:44:08,858 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml' 2025-11-27T00:44:08,859 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml' 2025-11-27T00:44:08,860 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml' 2025-11-27T00:44:08,861 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml' 2025-11-27T00:44:08,863 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml' 2025-11-27T00:44:08,864 adding 'lm_eval/tasks/afrobench/sib/prompt_3/utils.py' 2025-11-27T00:44:08,866 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib' 2025-11-27T00:44:08,867 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml' 2025-11-27T00:44:08,868 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml' 2025-11-27T00:44:08,870 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml' 2025-11-27T00:44:08,871 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml' 2025-11-27T00:44:08,872 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml' 2025-11-27T00:44:08,873 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml' 2025-11-27T00:44:08,874 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml' 2025-11-27T00:44:08,875 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml' 2025-11-27T00:44:08,876 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml' 2025-11-27T00:44:08,877 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml' 2025-11-27T00:44:08,879 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml' 2025-11-27T00:44:08,880 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml' 2025-11-27T00:44:08,881 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml' 2025-11-27T00:44:08,882 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml' 2025-11-27T00:44:08,883 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml' 2025-11-27T00:44:08,884 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml' 2025-11-27T00:44:08,886 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml' 2025-11-27T00:44:08,887 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml' 2025-11-27T00:44:08,888 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml' 2025-11-27T00:44:08,889 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml' 2025-11-27T00:44:08,890 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml' 2025-11-27T00:44:08,892 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml' 2025-11-27T00:44:08,893 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml' 2025-11-27T00:44:08,894 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml' 2025-11-27T00:44:08,895 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml' 2025-11-27T00:44:08,896 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml' 2025-11-27T00:44:08,897 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml' 2025-11-27T00:44:08,899 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml' 2025-11-27T00:44:08,900 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml' 2025-11-27T00:44:08,901 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml' 2025-11-27T00:44:08,902 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml' 2025-11-27T00:44:08,903 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml' 2025-11-27T00:44:08,904 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml' 2025-11-27T00:44:08,905 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml' 2025-11-27T00:44:08,907 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml' 2025-11-27T00:44:08,908 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml' 2025-11-27T00:44:08,909 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml' 2025-11-27T00:44:08,910 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml' 2025-11-27T00:44:08,912 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml' 2025-11-27T00:44:08,913 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml' 2025-11-27T00:44:08,914 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml' 2025-11-27T00:44:08,915 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml' 2025-11-27T00:44:08,916 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml' 2025-11-27T00:44:08,917 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml' 2025-11-27T00:44:08,918 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml' 2025-11-27T00:44:08,919 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml' 2025-11-27T00:44:08,920 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml' 2025-11-27T00:44:08,921 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml' 2025-11-27T00:44:08,922 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml' 2025-11-27T00:44:08,924 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml' 2025-11-27T00:44:08,925 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml' 2025-11-27T00:44:08,926 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml' 2025-11-27T00:44:08,927 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml' 2025-11-27T00:44:08,928 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml' 2025-11-27T00:44:08,929 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml' 2025-11-27T00:44:08,930 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml' 2025-11-27T00:44:08,931 adding 'lm_eval/tasks/afrobench/sib/prompt_4/utils.py' 2025-11-27T00:44:08,934 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib' 2025-11-27T00:44:08,935 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml' 2025-11-27T00:44:08,936 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml' 2025-11-27T00:44:08,938 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml' 2025-11-27T00:44:08,939 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml' 2025-11-27T00:44:08,940 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml' 2025-11-27T00:44:08,942 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml' 2025-11-27T00:44:08,943 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml' 2025-11-27T00:44:08,944 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml' 2025-11-27T00:44:08,945 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml' 2025-11-27T00:44:08,947 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml' 2025-11-27T00:44:08,948 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml' 2025-11-27T00:44:08,949 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml' 2025-11-27T00:44:08,951 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml' 2025-11-27T00:44:08,952 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml' 2025-11-27T00:44:08,953 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml' 2025-11-27T00:44:08,966 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml' 2025-11-27T00:44:08,968 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml' 2025-11-27T00:44:08,969 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml' 2025-11-27T00:44:08,971 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml' 2025-11-27T00:44:08,972 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml' 2025-11-27T00:44:08,974 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml' 2025-11-27T00:44:08,975 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml' 2025-11-27T00:44:08,976 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml' 2025-11-27T00:44:08,978 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml' 2025-11-27T00:44:08,979 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml' 2025-11-27T00:44:08,981 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml' 2025-11-27T00:44:08,982 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml' 2025-11-27T00:44:08,984 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml' 2025-11-27T00:44:08,985 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml' 2025-11-27T00:44:08,987 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml' 2025-11-27T00:44:08,988 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml' 2025-11-27T00:44:08,990 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml' 2025-11-27T00:44:08,991 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml' 2025-11-27T00:44:08,993 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml' 2025-11-27T00:44:08,994 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml' 2025-11-27T00:44:08,996 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml' 2025-11-27T00:44:08,997 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml' 2025-11-27T00:44:08,999 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml' 2025-11-27T00:44:09,000 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml' 2025-11-27T00:44:09,002 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml' 2025-11-27T00:44:09,003 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml' 2025-11-27T00:44:09,005 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml' 2025-11-27T00:44:09,006 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml' 2025-11-27T00:44:09,008 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml' 2025-11-27T00:44:09,009 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml' 2025-11-27T00:44:09,010 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml' 2025-11-27T00:44:09,011 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml' 2025-11-27T00:44:09,013 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml' 2025-11-27T00:44:09,014 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml' 2025-11-27T00:44:09,015 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml' 2025-11-27T00:44:09,016 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml' 2025-11-27T00:44:09,017 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml' 2025-11-27T00:44:09,019 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml' 2025-11-27T00:44:09,020 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml' 2025-11-27T00:44:09,021 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml' 2025-11-27T00:44:09,022 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml' 2025-11-27T00:44:09,023 adding 'lm_eval/tasks/afrobench/sib/prompt_5/utils.py' 2025-11-27T00:44:09,025 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/README.md' 2025-11-27T00:44:09,027 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml' 2025-11-27T00:44:09,028 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/utils.py' 2025-11-27T00:44:09,030 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy' 2025-11-27T00:44:09,031 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml' 2025-11-27T00:44:09,032 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml' 2025-11-27T00:44:09,033 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml' 2025-11-27T00:44:09,035 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml' 2025-11-27T00:44:09,036 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml' 2025-11-27T00:44:09,037 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml' 2025-11-27T00:44:09,038 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml' 2025-11-27T00:44:09,039 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py' 2025-11-27T00:44:09,041 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy' 2025-11-27T00:44:09,042 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml' 2025-11-27T00:44:09,044 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml' 2025-11-27T00:44:09,045 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml' 2025-11-27T00:44:09,046 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml' 2025-11-27T00:44:09,047 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml' 2025-11-27T00:44:09,048 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml' 2025-11-27T00:44:09,049 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml' 2025-11-27T00:44:09,050 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py' 2025-11-27T00:44:09,052 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy' 2025-11-27T00:44:09,053 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml' 2025-11-27T00:44:09,054 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml' 2025-11-27T00:44:09,055 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml' 2025-11-27T00:44:09,056 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml' 2025-11-27T00:44:09,057 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml' 2025-11-27T00:44:09,059 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml' 2025-11-27T00:44:09,060 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml' 2025-11-27T00:44:09,061 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py' 2025-11-27T00:44:09,063 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy' 2025-11-27T00:44:09,064 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml' 2025-11-27T00:44:09,065 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml' 2025-11-27T00:44:09,066 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml' 2025-11-27T00:44:09,067 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml' 2025-11-27T00:44:09,068 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml' 2025-11-27T00:44:09,070 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml' 2025-11-27T00:44:09,071 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml' 2025-11-27T00:44:09,072 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py' 2025-11-27T00:44:09,074 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy' 2025-11-27T00:44:09,075 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml' 2025-11-27T00:44:09,076 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml' 2025-11-27T00:44:09,078 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml' 2025-11-27T00:44:09,079 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml' 2025-11-27T00:44:09,080 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml' 2025-11-27T00:44:09,081 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml' 2025-11-27T00:44:09,082 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml' 2025-11-27T00:44:09,083 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py' 2025-11-27T00:44:09,085 adding 'lm_eval/tasks/afrobench/xlsum/README.md' 2025-11-27T00:44:09,087 adding 'lm_eval/tasks/afrobench/xlsum/utils.py' 2025-11-27T00:44:09,088 adding 'lm_eval/tasks/afrobench/xlsum/xlsum.yaml' 2025-11-27T00:44:09,090 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py' 2025-11-27T00:44:09,091 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum' 2025-11-27T00:44:09,092 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml' 2025-11-27T00:44:09,094 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml' 2025-11-27T00:44:09,095 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml' 2025-11-27T00:44:09,096 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml' 2025-11-27T00:44:09,097 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml' 2025-11-27T00:44:09,098 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml' 2025-11-27T00:44:09,100 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml' 2025-11-27T00:44:09,101 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml' 2025-11-27T00:44:09,102 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml' 2025-11-27T00:44:09,103 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml' 2025-11-27T00:44:09,104 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml' 2025-11-27T00:44:09,105 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml' 2025-11-27T00:44:09,107 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py' 2025-11-27T00:44:09,108 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum' 2025-11-27T00:44:09,109 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml' 2025-11-27T00:44:09,110 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml' 2025-11-27T00:44:09,111 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml' 2025-11-27T00:44:09,113 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml' 2025-11-27T00:44:09,114 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml' 2025-11-27T00:44:09,115 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml' 2025-11-27T00:44:09,116 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml' 2025-11-27T00:44:09,117 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml' 2025-11-27T00:44:09,118 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml' 2025-11-27T00:44:09,119 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml' 2025-11-27T00:44:09,121 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml' 2025-11-27T00:44:09,122 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml' 2025-11-27T00:44:09,123 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py' 2025-11-27T00:44:09,125 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum' 2025-11-27T00:44:09,126 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml' 2025-11-27T00:44:09,127 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml' 2025-11-27T00:44:09,128 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml' 2025-11-27T00:44:09,129 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml' 2025-11-27T00:44:09,131 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml' 2025-11-27T00:44:09,132 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml' 2025-11-27T00:44:09,133 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml' 2025-11-27T00:44:09,134 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml' 2025-11-27T00:44:09,136 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml' 2025-11-27T00:44:09,137 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml' 2025-11-27T00:44:09,138 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml' 2025-11-27T00:44:09,139 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml' 2025-11-27T00:44:09,142 adding 'lm_eval/tasks/agieval/README.md' 2025-11-27T00:44:09,143 adding 'lm_eval/tasks/agieval/agieval.yaml' 2025-11-27T00:44:09,144 adding 'lm_eval/tasks/agieval/agieval_cn.yaml' 2025-11-27T00:44:09,146 adding 'lm_eval/tasks/agieval/agieval_en.yaml' 2025-11-27T00:44:09,147 adding 'lm_eval/tasks/agieval/agieval_nous.yaml' 2025-11-27T00:44:09,148 adding 'lm_eval/tasks/agieval/aqua-rat.yaml' 2025-11-27T00:44:09,149 adding 'lm_eval/tasks/agieval/gaokao-biology.yaml' 2025-11-27T00:44:09,150 adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml' 2025-11-27T00:44:09,152 adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml' 2025-11-27T00:44:09,153 adding 'lm_eval/tasks/agieval/gaokao-english.yaml' 2025-11-27T00:44:09,154 adding 'lm_eval/tasks/agieval/gaokao-geography.yaml' 2025-11-27T00:44:09,155 adding 'lm_eval/tasks/agieval/gaokao-history.yaml' 2025-11-27T00:44:09,156 adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml' 2025-11-27T00:44:09,157 adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml' 2025-11-27T00:44:09,159 adding 'lm_eval/tasks/agieval/gaokao-physics.yaml' 2025-11-27T00:44:09,160 adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml' 2025-11-27T00:44:09,161 adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml' 2025-11-27T00:44:09,162 adding 'lm_eval/tasks/agieval/logiqa-en.yaml' 2025-11-27T00:44:09,163 adding 'lm_eval/tasks/agieval/logiqa-zh.yaml' 2025-11-27T00:44:09,164 adding 'lm_eval/tasks/agieval/lsat-ar.yaml' 2025-11-27T00:44:09,165 adding 'lm_eval/tasks/agieval/lsat-lr.yaml' 2025-11-27T00:44:09,166 adding 'lm_eval/tasks/agieval/lsat-rc.yaml' 2025-11-27T00:44:09,167 adding 'lm_eval/tasks/agieval/math.yaml' 2025-11-27T00:44:09,168 adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml' 2025-11-27T00:44:09,170 adding 'lm_eval/tasks/agieval/sat-en.yaml' 2025-11-27T00:44:09,171 adding 'lm_eval/tasks/agieval/sat-math.yaml' 2025-11-27T00:44:09,173 adding 'lm_eval/tasks/agieval/utils.py' 2025-11-27T00:44:09,175 adding 'lm_eval/tasks/aime/README.md' 2025-11-27T00:44:09,176 adding 'lm_eval/tasks/aime/aime.yaml' 2025-11-27T00:44:09,177 adding 'lm_eval/tasks/aime/aime24.yaml' 2025-11-27T00:44:09,179 adding 'lm_eval/tasks/aime/aime25.yaml' 2025-11-27T00:44:09,180 adding 'lm_eval/tasks/aime/utils.py' 2025-11-27T00:44:09,183 adding 'lm_eval/tasks/alghafa/copa_ar/README.md' 2025-11-27T00:44:09,184 adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml' 2025-11-27T00:44:09,186 adding 'lm_eval/tasks/alghafa/piqa_ar/README.md' 2025-11-27T00:44:09,187 adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml' 2025-11-27T00:44:09,189 adding 'lm_eval/tasks/anli/README.md' 2025-11-27T00:44:09,190 adding 'lm_eval/tasks/anli/anli_r1.yaml' 2025-11-27T00:44:09,191 adding 'lm_eval/tasks/anli/anli_r2.yaml' 2025-11-27T00:44:09,193 adding 'lm_eval/tasks/anli/anli_r3.yaml' 2025-11-27T00:44:09,195 adding 'lm_eval/tasks/arab_culture/README.md' 2025-11-27T00:44:09,196 adding 'lm_eval/tasks/arab_culture/_arab_culture.yaml' 2025-11-27T00:44:09,198 adding 'lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml' 2025-11-27T00:44:09,199 adding 'lm_eval/tasks/arab_culture/_arab_culture_levant.yaml' 2025-11-27T00:44:09,200 adding 'lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml' 2025-11-27T00:44:09,201 adding 'lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml' 2025-11-27T00:44:09,202 adding 'lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml' 2025-11-27T00:44:09,204 adding 'lm_eval/tasks/arab_culture/_generate_configs.py' 2025-11-27T00:44:09,205 adding 'lm_eval/tasks/arab_culture/arab_culture_algeria.yaml' 2025-11-27T00:44:09,206 adding 'lm_eval/tasks/arab_culture/arab_culture_egypt.yaml' 2025-11-27T00:44:09,207 adding 'lm_eval/tasks/arab_culture/arab_culture_jordan.yaml' 2025-11-27T00:44:09,209 adding 'lm_eval/tasks/arab_culture/arab_culture_ksa.yaml' 2025-11-27T00:44:09,210 adding 'lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml' 2025-11-27T00:44:09,211 adding 'lm_eval/tasks/arab_culture/arab_culture_libya.yaml' 2025-11-27T00:44:09,212 adding 'lm_eval/tasks/arab_culture/arab_culture_morocco.yaml' 2025-11-27T00:44:09,213 adding 'lm_eval/tasks/arab_culture/arab_culture_palestine.yaml' 2025-11-27T00:44:09,214 adding 'lm_eval/tasks/arab_culture/arab_culture_sudan.yaml' 2025-11-27T00:44:09,216 adding 'lm_eval/tasks/arab_culture/arab_culture_syria.yaml' 2025-11-27T00:44:09,217 adding 'lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml' 2025-11-27T00:44:09,218 adding 'lm_eval/tasks/arab_culture/arab_culture_uae.yaml' 2025-11-27T00:44:09,219 adding 'lm_eval/tasks/arab_culture/arab_culture_yemen.yaml' 2025-11-27T00:44:09,221 adding 'lm_eval/tasks/arab_culture/prompts.py' 2025-11-27T00:44:09,223 adding 'lm_eval/tasks/arab_culture/utils_mcq.py' 2025-11-27T00:44:09,225 adding 'lm_eval/tasks/arab_culture_completion/README.md' 2025-11-27T00:44:09,227 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml' 2025-11-27T00:44:09,228 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml' 2025-11-27T00:44:09,229 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml' 2025-11-27T00:44:09,230 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml' 2025-11-27T00:44:09,231 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml' 2025-11-27T00:44:09,233 adding 'lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml' 2025-11-27T00:44:09,234 adding 'lm_eval/tasks/arab_culture_completion/_generate_configs.py' 2025-11-27T00:44:09,235 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml' 2025-11-27T00:44:09,236 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml' 2025-11-27T00:44:09,238 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml' 2025-11-27T00:44:09,239 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml' 2025-11-27T00:44:09,240 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml' 2025-11-27T00:44:09,241 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml' 2025-11-27T00:44:09,243 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml' 2025-11-27T00:44:09,244 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml' 2025-11-27T00:44:09,245 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml' 2025-11-27T00:44:09,246 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml' 2025-11-27T00:44:09,247 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml' 2025-11-27T00:44:09,248 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml' 2025-11-27T00:44:09,250 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml' 2025-11-27T00:44:09,252 adding 'lm_eval/tasks/arab_culture_completion/prompts.py' 2025-11-27T00:44:09,253 adding 'lm_eval/tasks/arab_culture_completion/utils_completion.py' 2025-11-27T00:44:09,256 adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md' 2025-11-27T00:44:09,258 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml' 2025-11-27T00:44:09,260 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml' 2025-11-27T00:44:09,261 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml' 2025-11-27T00:44:09,262 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml' 2025-11-27T00:44:09,263 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml' 2025-11-27T00:44:09,265 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml' 2025-11-27T00:44:09,266 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml' 2025-11-27T00:44:09,267 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml' 2025-11-27T00:44:09,268 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml' 2025-11-27T00:44:09,270 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml' 2025-11-27T00:44:09,271 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml' 2025-11-27T00:44:09,272 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py' 2025-11-27T00:44:09,274 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml' 2025-11-27T00:44:09,275 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml' 2025-11-27T00:44:09,276 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py' 2025-11-27T00:44:09,279 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml' 2025-11-27T00:44:09,281 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml' 2025-11-27T00:44:09,282 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml' 2025-11-27T00:44:09,283 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml' 2025-11-27T00:44:09,285 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml' 2025-11-27T00:44:09,286 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:09,287 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml' 2025-11-27T00:44:09,288 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml' 2025-11-27T00:44:09,290 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml' 2025-11-27T00:44:09,291 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml' 2025-11-27T00:44:09,292 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml' 2025-11-27T00:44:09,293 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml' 2025-11-27T00:44:09,295 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml' 2025-11-27T00:44:09,296 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml' 2025-11-27T00:44:09,297 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml' 2025-11-27T00:44:09,299 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml' 2025-11-27T00:44:09,300 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:09,301 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml' 2025-11-27T00:44:09,303 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml' 2025-11-27T00:44:09,304 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml' 2025-11-27T00:44:09,305 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:09,307 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:09,308 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml' 2025-11-27T00:44:09,309 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml' 2025-11-27T00:44:09,311 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:09,312 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:09,313 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:09,314 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:09,315 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml' 2025-11-27T00:44:09,316 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml' 2025-11-27T00:44:09,317 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml' 2025-11-27T00:44:09,319 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml' 2025-11-27T00:44:09,320 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml' 2025-11-27T00:44:09,321 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml' 2025-11-27T00:44:09,322 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml' 2025-11-27T00:44:09,323 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml' 2025-11-27T00:44:09,325 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml' 2025-11-27T00:44:09,326 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml' 2025-11-27T00:44:09,327 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml' 2025-11-27T00:44:09,328 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml' 2025-11-27T00:44:09,330 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml' 2025-11-27T00:44:09,331 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml' 2025-11-27T00:44:09,332 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml' 2025-11-27T00:44:09,333 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml' 2025-11-27T00:44:09,334 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml' 2025-11-27T00:44:09,336 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml' 2025-11-27T00:44:09,337 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml' 2025-11-27T00:44:09,338 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml' 2025-11-27T00:44:09,339 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml' 2025-11-27T00:44:09,340 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml' 2025-11-27T00:44:09,341 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml' 2025-11-27T00:44:09,343 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml' 2025-11-27T00:44:09,344 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml' 2025-11-27T00:44:09,345 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml' 2025-11-27T00:44:09,346 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml' 2025-11-27T00:44:09,347 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:09,348 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml' 2025-11-27T00:44:09,350 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml' 2025-11-27T00:44:09,351 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py' 2025-11-27T00:44:09,353 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml' 2025-11-27T00:44:09,354 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml' 2025-11-27T00:44:09,355 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py' 2025-11-27T00:44:09,357 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml' 2025-11-27T00:44:09,358 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml' 2025-11-27T00:44:09,359 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py' 2025-11-27T00:44:09,361 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml' 2025-11-27T00:44:09,362 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml' 2025-11-27T00:44:09,364 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py' 2025-11-27T00:44:09,365 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml' 2025-11-27T00:44:09,367 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml' 2025-11-27T00:44:09,368 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py' 2025-11-27T00:44:09,370 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml' 2025-11-27T00:44:09,371 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml' 2025-11-27T00:44:09,372 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py' 2025-11-27T00:44:09,374 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml' 2025-11-27T00:44:09,375 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml' 2025-11-27T00:44:09,376 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py' 2025-11-27T00:44:09,378 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml' 2025-11-27T00:44:09,379 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml' 2025-11-27T00:44:09,380 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py' 2025-11-27T00:44:09,382 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml' 2025-11-27T00:44:09,383 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml' 2025-11-27T00:44:09,385 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py' 2025-11-27T00:44:09,386 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml' 2025-11-27T00:44:09,387 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml' 2025-11-27T00:44:09,389 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py' 2025-11-27T00:44:09,390 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml' 2025-11-27T00:44:09,391 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml' 2025-11-27T00:44:09,393 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py' 2025-11-27T00:44:09,394 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml' 2025-11-27T00:44:09,396 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml' 2025-11-27T00:44:09,397 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py' 2025-11-27T00:44:09,400 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml' 2025-11-27T00:44:09,401 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml' 2025-11-27T00:44:09,402 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml' 2025-11-27T00:44:09,404 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml' 2025-11-27T00:44:09,405 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml' 2025-11-27T00:44:09,406 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml' 2025-11-27T00:44:09,407 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml' 2025-11-27T00:44:09,409 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml' 2025-11-27T00:44:09,410 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml' 2025-11-27T00:44:09,411 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml' 2025-11-27T00:44:09,412 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml' 2025-11-27T00:44:09,414 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml' 2025-11-27T00:44:09,415 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml' 2025-11-27T00:44:09,416 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml' 2025-11-27T00:44:09,417 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml' 2025-11-27T00:44:09,418 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml' 2025-11-27T00:44:09,420 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml' 2025-11-27T00:44:09,421 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml' 2025-11-27T00:44:09,422 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml' 2025-11-27T00:44:09,423 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml' 2025-11-27T00:44:09,425 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml' 2025-11-27T00:44:09,426 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml' 2025-11-27T00:44:09,427 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml' 2025-11-27T00:44:09,428 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml' 2025-11-27T00:44:09,429 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml' 2025-11-27T00:44:09,431 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml' 2025-11-27T00:44:09,432 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml' 2025-11-27T00:44:09,433 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml' 2025-11-27T00:44:09,434 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml' 2025-11-27T00:44:09,435 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml' 2025-11-27T00:44:09,437 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml' 2025-11-27T00:44:09,438 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml' 2025-11-27T00:44:09,439 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml' 2025-11-27T00:44:09,440 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml' 2025-11-27T00:44:09,442 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml' 2025-11-27T00:44:09,443 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml' 2025-11-27T00:44:09,444 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml' 2025-11-27T00:44:09,445 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml' 2025-11-27T00:44:09,446 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml' 2025-11-27T00:44:09,448 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml' 2025-11-27T00:44:09,449 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml' 2025-11-27T00:44:09,450 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml' 2025-11-27T00:44:09,451 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml' 2025-11-27T00:44:09,452 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml' 2025-11-27T00:44:09,453 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml' 2025-11-27T00:44:09,455 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml' 2025-11-27T00:44:09,456 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml' 2025-11-27T00:44:09,457 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml' 2025-11-27T00:44:09,458 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml' 2025-11-27T00:44:09,460 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml' 2025-11-27T00:44:09,461 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml' 2025-11-27T00:44:09,462 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml' 2025-11-27T00:44:09,463 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml' 2025-11-27T00:44:09,464 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml' 2025-11-27T00:44:09,465 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml' 2025-11-27T00:44:09,467 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml' 2025-11-27T00:44:09,468 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml' 2025-11-27T00:44:09,469 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml' 2025-11-27T00:44:09,470 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml' 2025-11-27T00:44:09,471 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py' 2025-11-27T00:44:09,473 adding 'lm_eval/tasks/arabic_leaderboard_light/README.md' 2025-11-27T00:44:09,475 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml' 2025-11-27T00:44:09,477 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml' 2025-11-27T00:44:09,478 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml' 2025-11-27T00:44:09,479 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml' 2025-11-27T00:44:09,480 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml' 2025-11-27T00:44:09,481 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml' 2025-11-27T00:44:09,483 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml' 2025-11-27T00:44:09,484 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml' 2025-11-27T00:44:09,485 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml' 2025-11-27T00:44:09,486 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml' 2025-11-27T00:44:09,488 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml' 2025-11-27T00:44:09,489 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py' 2025-11-27T00:44:09,491 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml' 2025-11-27T00:44:09,492 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml' 2025-11-27T00:44:09,493 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py' 2025-11-27T00:44:09,496 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml' 2025-11-27T00:44:09,497 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml' 2025-11-27T00:44:09,498 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml' 2025-11-27T00:44:09,500 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml' 2025-11-27T00:44:09,501 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml' 2025-11-27T00:44:09,502 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml' 2025-11-27T00:44:09,503 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml' 2025-11-27T00:44:09,504 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml' 2025-11-27T00:44:09,505 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml' 2025-11-27T00:44:09,507 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml' 2025-11-27T00:44:09,508 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml' 2025-11-27T00:44:09,509 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml' 2025-11-27T00:44:09,510 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml' 2025-11-27T00:44:09,512 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml' 2025-11-27T00:44:09,513 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml' 2025-11-27T00:44:09,514 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml' 2025-11-27T00:44:09,515 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml' 2025-11-27T00:44:09,516 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml' 2025-11-27T00:44:09,518 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml' 2025-11-27T00:44:09,519 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml' 2025-11-27T00:44:09,520 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml' 2025-11-27T00:44:09,521 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml' 2025-11-27T00:44:09,522 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml' 2025-11-27T00:44:09,524 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml' 2025-11-27T00:44:09,525 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml' 2025-11-27T00:44:09,526 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml' 2025-11-27T00:44:09,527 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml' 2025-11-27T00:44:09,528 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml' 2025-11-27T00:44:09,529 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml' 2025-11-27T00:44:09,531 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml' 2025-11-27T00:44:09,532 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml' 2025-11-27T00:44:09,533 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml' 2025-11-27T00:44:09,534 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml' 2025-11-27T00:44:09,535 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml' 2025-11-27T00:44:09,537 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml' 2025-11-27T00:44:09,538 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml' 2025-11-27T00:44:09,539 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml' 2025-11-27T00:44:09,540 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml' 2025-11-27T00:44:09,542 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml' 2025-11-27T00:44:09,543 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml' 2025-11-27T00:44:09,544 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml' 2025-11-27T00:44:09,545 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml' 2025-11-27T00:44:09,547 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml' 2025-11-27T00:44:09,548 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml' 2025-11-27T00:44:09,549 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml' 2025-11-27T00:44:09,550 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml' 2025-11-27T00:44:09,551 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml' 2025-11-27T00:44:09,552 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml' 2025-11-27T00:44:09,554 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml' 2025-11-27T00:44:09,555 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml' 2025-11-27T00:44:09,556 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml' 2025-11-27T00:44:09,557 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml' 2025-11-27T00:44:09,558 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml' 2025-11-27T00:44:09,559 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml' 2025-11-27T00:44:09,561 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml' 2025-11-27T00:44:09,562 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml' 2025-11-27T00:44:09,563 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml' 2025-11-27T00:44:09,564 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml' 2025-11-27T00:44:09,565 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py' 2025-11-27T00:44:09,567 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml' 2025-11-27T00:44:09,568 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml' 2025-11-27T00:44:09,570 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py' 2025-11-27T00:44:09,572 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml' 2025-11-27T00:44:09,573 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml' 2025-11-27T00:44:09,574 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py' 2025-11-27T00:44:09,576 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml' 2025-11-27T00:44:09,577 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml' 2025-11-27T00:44:09,578 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py' 2025-11-27T00:44:09,580 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml' 2025-11-27T00:44:09,581 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml' 2025-11-27T00:44:09,582 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py' 2025-11-27T00:44:09,584 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml' 2025-11-27T00:44:09,585 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml' 2025-11-27T00:44:09,586 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py' 2025-11-27T00:44:09,588 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml' 2025-11-27T00:44:09,589 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml' 2025-11-27T00:44:09,591 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py' 2025-11-27T00:44:09,592 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml' 2025-11-27T00:44:09,593 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml' 2025-11-27T00:44:09,595 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py' 2025-11-27T00:44:09,596 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml' 2025-11-27T00:44:09,598 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml' 2025-11-27T00:44:09,599 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py' 2025-11-27T00:44:09,601 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml' 2025-11-27T00:44:09,602 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml' 2025-11-27T00:44:09,603 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py' 2025-11-27T00:44:09,605 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml' 2025-11-27T00:44:09,606 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml' 2025-11-27T00:44:09,607 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py' 2025-11-27T00:44:09,609 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml' 2025-11-27T00:44:09,610 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml' 2025-11-27T00:44:09,611 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py' 2025-11-27T00:44:09,614 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml' 2025-11-27T00:44:09,616 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml' 2025-11-27T00:44:09,617 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml' 2025-11-27T00:44:09,618 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml' 2025-11-27T00:44:09,619 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml' 2025-11-27T00:44:09,620 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml' 2025-11-27T00:44:09,622 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml' 2025-11-27T00:44:09,623 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml' 2025-11-27T00:44:09,624 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml' 2025-11-27T00:44:09,625 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml' 2025-11-27T00:44:09,626 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml' 2025-11-27T00:44:09,628 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml' 2025-11-27T00:44:09,629 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml' 2025-11-27T00:44:09,630 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml' 2025-11-27T00:44:09,631 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml' 2025-11-27T00:44:09,632 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml' 2025-11-27T00:44:09,634 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml' 2025-11-27T00:44:09,635 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml' 2025-11-27T00:44:09,636 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml' 2025-11-27T00:44:09,637 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml' 2025-11-27T00:44:09,638 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml' 2025-11-27T00:44:09,640 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml' 2025-11-27T00:44:09,641 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml' 2025-11-27T00:44:09,642 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml' 2025-11-27T00:44:09,643 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml' 2025-11-27T00:44:09,644 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml' 2025-11-27T00:44:09,646 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml' 2025-11-27T00:44:09,647 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml' 2025-11-27T00:44:09,648 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml' 2025-11-27T00:44:09,649 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml' 2025-11-27T00:44:09,651 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml' 2025-11-27T00:44:09,652 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml' 2025-11-27T00:44:09,653 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml' 2025-11-27T00:44:09,654 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml' 2025-11-27T00:44:09,655 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml' 2025-11-27T00:44:09,656 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml' 2025-11-27T00:44:09,657 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml' 2025-11-27T00:44:09,659 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml' 2025-11-27T00:44:09,660 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml' 2025-11-27T00:44:09,661 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml' 2025-11-27T00:44:09,662 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml' 2025-11-27T00:44:09,663 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml' 2025-11-27T00:44:09,665 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml' 2025-11-27T00:44:09,666 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml' 2025-11-27T00:44:09,667 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml' 2025-11-27T00:44:09,668 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml' 2025-11-27T00:44:09,669 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml' 2025-11-27T00:44:09,671 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml' 2025-11-27T00:44:09,672 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml' 2025-11-27T00:44:09,673 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml' 2025-11-27T00:44:09,674 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml' 2025-11-27T00:44:09,675 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml' 2025-11-27T00:44:09,677 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml' 2025-11-27T00:44:09,678 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml' 2025-11-27T00:44:09,679 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml' 2025-11-27T00:44:09,680 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml' 2025-11-27T00:44:09,682 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml' 2025-11-27T00:44:09,683 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml' 2025-11-27T00:44:09,684 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml' 2025-11-27T00:44:09,685 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py' 2025-11-27T00:44:09,688 adding 'lm_eval/tasks/arabicmmlu/README.md' 2025-11-27T00:44:09,689 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml' 2025-11-27T00:44:09,690 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml' 2025-11-27T00:44:09,691 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml' 2025-11-27T00:44:09,692 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml' 2025-11-27T00:44:09,693 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml' 2025-11-27T00:44:09,695 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml' 2025-11-27T00:44:09,696 adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml' 2025-11-27T00:44:09,697 adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py' 2025-11-27T00:44:09,698 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml' 2025-11-27T00:44:09,700 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml' 2025-11-27T00:44:09,701 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml' 2025-11-27T00:44:09,702 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml' 2025-11-27T00:44:09,703 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml' 2025-11-27T00:44:09,704 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml' 2025-11-27T00:44:09,705 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml' 2025-11-27T00:44:09,706 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml' 2025-11-27T00:44:09,707 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml' 2025-11-27T00:44:09,709 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml' 2025-11-27T00:44:09,710 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml' 2025-11-27T00:44:09,711 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml' 2025-11-27T00:44:09,712 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml' 2025-11-27T00:44:09,713 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml' 2025-11-27T00:44:09,714 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml' 2025-11-27T00:44:09,716 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml' 2025-11-27T00:44:09,717 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml' 2025-11-27T00:44:09,718 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml' 2025-11-27T00:44:09,719 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml' 2025-11-27T00:44:09,720 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml' 2025-11-27T00:44:09,721 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml' 2025-11-27T00:44:09,723 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml' 2025-11-27T00:44:09,724 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml' 2025-11-27T00:44:09,725 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml' 2025-11-27T00:44:09,726 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml' 2025-11-27T00:44:09,727 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml' 2025-11-27T00:44:09,728 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml' 2025-11-27T00:44:09,730 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml' 2025-11-27T00:44:09,731 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml' 2025-11-27T00:44:09,732 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml' 2025-11-27T00:44:09,733 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml' 2025-11-27T00:44:09,734 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml' 2025-11-27T00:44:09,735 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml' 2025-11-27T00:44:09,736 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml' 2025-11-27T00:44:09,737 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml' 2025-11-27T00:44:09,739 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml' 2025-11-27T00:44:09,740 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml' 2025-11-27T00:44:09,741 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml' 2025-11-27T00:44:09,742 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml' 2025-11-27T00:44:09,743 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml' 2025-11-27T00:44:09,745 adding 'lm_eval/tasks/arabicmmlu/utils.py' 2025-11-27T00:44:09,747 adding 'lm_eval/tasks/aradice/README.md' 2025-11-27T00:44:09,748 adding 'lm_eval/tasks/aradice/aradice.yaml' 2025-11-27T00:44:09,751 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml' 2025-11-27T00:44:09,752 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2025-11-27T00:44:09,753 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,754 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2025-11-27T00:44:09,755 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2025-11-27T00:44:09,756 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2025-11-27T00:44:09,758 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2025-11-27T00:44:09,759 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2025-11-27T00:44:09,760 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2025-11-27T00:44:09,761 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2025-11-27T00:44:09,762 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2025-11-27T00:44:09,763 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2025-11-27T00:44:09,765 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,766 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2025-11-27T00:44:09,767 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2025-11-27T00:44:09,768 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2025-11-27T00:44:09,769 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2025-11-27T00:44:09,771 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2025-11-27T00:44:09,772 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2025-11-27T00:44:09,773 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2025-11-27T00:44:09,774 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2025-11-27T00:44:09,775 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,777 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2025-11-27T00:44:09,778 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2025-11-27T00:44:09,779 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2025-11-27T00:44:09,780 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2025-11-27T00:44:09,781 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2025-11-27T00:44:09,782 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,783 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2025-11-27T00:44:09,785 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2025-11-27T00:44:09,786 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2025-11-27T00:44:09,787 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2025-11-27T00:44:09,788 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2025-11-27T00:44:09,789 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2025-11-27T00:44:09,790 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2025-11-27T00:44:09,792 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2025-11-27T00:44:09,793 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2025-11-27T00:44:09,794 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2025-11-27T00:44:09,795 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2025-11-27T00:44:09,796 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2025-11-27T00:44:09,797 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2025-11-27T00:44:09,799 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml' 2025-11-27T00:44:09,800 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py' 2025-11-27T00:44:09,801 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py' 2025-11-27T00:44:09,804 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml' 2025-11-27T00:44:09,805 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2025-11-27T00:44:09,806 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,808 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2025-11-27T00:44:09,809 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2025-11-27T00:44:09,810 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2025-11-27T00:44:09,811 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2025-11-27T00:44:09,812 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2025-11-27T00:44:09,814 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2025-11-27T00:44:09,815 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2025-11-27T00:44:09,816 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2025-11-27T00:44:09,817 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2025-11-27T00:44:09,819 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,820 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2025-11-27T00:44:09,821 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2025-11-27T00:44:09,822 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2025-11-27T00:44:09,823 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2025-11-27T00:44:09,824 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2025-11-27T00:44:09,825 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2025-11-27T00:44:09,826 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2025-11-27T00:44:09,828 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2025-11-27T00:44:09,829 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,830 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2025-11-27T00:44:09,831 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2025-11-27T00:44:09,832 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2025-11-27T00:44:09,833 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2025-11-27T00:44:09,835 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2025-11-27T00:44:09,836 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2025-11-27T00:44:09,837 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2025-11-27T00:44:09,838 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2025-11-27T00:44:09,839 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2025-11-27T00:44:09,841 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2025-11-27T00:44:09,842 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2025-11-27T00:44:09,843 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2025-11-27T00:44:09,844 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2025-11-27T00:44:09,845 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2025-11-27T00:44:09,846 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2025-11-27T00:44:09,848 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2025-11-27T00:44:09,849 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2025-11-27T00:44:09,850 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2025-11-27T00:44:09,851 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2025-11-27T00:44:09,852 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml' 2025-11-27T00:44:09,854 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py' 2025-11-27T00:44:09,855 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py' 2025-11-27T00:44:09,858 adding 'lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml' 2025-11-27T00:44:09,859 adding 'lm_eval/tasks/aradice/boolq/EGY/metrics.py' 2025-11-27T00:44:09,860 adding 'lm_eval/tasks/aradice/boolq/EGY/utils.py' 2025-11-27T00:44:09,862 adding 'lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml' 2025-11-27T00:44:09,863 adding 'lm_eval/tasks/aradice/boolq/ENG/metrics.py' 2025-11-27T00:44:09,864 adding 'lm_eval/tasks/aradice/boolq/ENG/utils.py' 2025-11-27T00:44:09,866 adding 'lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml' 2025-11-27T00:44:09,867 adding 'lm_eval/tasks/aradice/boolq/LEV/metrics.py' 2025-11-27T00:44:09,868 adding 'lm_eval/tasks/aradice/boolq/LEV/utils.py' 2025-11-27T00:44:09,870 adding 'lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml' 2025-11-27T00:44:09,871 adding 'lm_eval/tasks/aradice/boolq/MSA/metrics.py' 2025-11-27T00:44:09,872 adding 'lm_eval/tasks/aradice/boolq/MSA/utils.py' 2025-11-27T00:44:09,874 adding 'lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml' 2025-11-27T00:44:09,875 adding 'lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml' 2025-11-27T00:44:09,876 adding 'lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml' 2025-11-27T00:44:09,878 adding 'lm_eval/tasks/aradice/cultural-benchmark/metrics.py' 2025-11-27T00:44:09,879 adding 'lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml' 2025-11-27T00:44:09,880 adding 'lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml' 2025-11-27T00:44:09,881 adding 'lm_eval/tasks/aradice/cultural-benchmark/syria.yaml' 2025-11-27T00:44:09,882 adding 'lm_eval/tasks/aradice/cultural-benchmark/utils.py' 2025-11-27T00:44:09,884 adding 'lm_eval/tasks/aradice/openbookqa/metrics.py' 2025-11-27T00:44:09,885 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml' 2025-11-27T00:44:09,886 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml' 2025-11-27T00:44:09,888 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml' 2025-11-27T00:44:09,889 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml' 2025-11-27T00:44:09,890 adding 'lm_eval/tasks/aradice/openbookqa/utils.py' 2025-11-27T00:44:09,892 adding 'lm_eval/tasks/aradice/piqa/metrics.py' 2025-11-27T00:44:09,893 adding 'lm_eval/tasks/aradice/piqa/piqa_egy.yaml' 2025-11-27T00:44:09,894 adding 'lm_eval/tasks/aradice/piqa/piqa_eng.yaml' 2025-11-27T00:44:09,895 adding 'lm_eval/tasks/aradice/piqa/piqa_lev.yaml' 2025-11-27T00:44:09,897 adding 'lm_eval/tasks/aradice/piqa/piqa_msa.yaml' 2025-11-27T00:44:09,899 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py' 2025-11-27T00:44:09,900 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml' 2025-11-27T00:44:09,901 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml' 2025-11-27T00:44:09,902 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml' 2025-11-27T00:44:09,904 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml' 2025-11-27T00:44:09,906 adding 'lm_eval/tasks/aradice/winogrande/metrics.py' 2025-11-27T00:44:09,907 adding 'lm_eval/tasks/aradice/winogrande/utils.py' 2025-11-27T00:44:09,908 adding 'lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml' 2025-11-27T00:44:09,909 adding 'lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml' 2025-11-27T00:44:09,910 adding 'lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml' 2025-11-27T00:44:09,912 adding 'lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml' 2025-11-27T00:44:09,914 adding 'lm_eval/tasks/arc/README.md' 2025-11-27T00:44:09,915 adding 'lm_eval/tasks/arc/arc_challenge.yaml' 2025-11-27T00:44:09,916 adding 'lm_eval/tasks/arc/arc_challenge_chat.yaml' 2025-11-27T00:44:09,917 adding 'lm_eval/tasks/arc/arc_easy.yaml' 2025-11-27T00:44:09,919 adding 'lm_eval/tasks/arc_mt/README.md' 2025-11-27T00:44:09,920 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml' 2025-11-27T00:44:09,922 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml' 2025-11-27T00:44:09,923 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml' 2025-11-27T00:44:09,924 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml' 2025-11-27T00:44:09,925 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml' 2025-11-27T00:44:09,926 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml' 2025-11-27T00:44:09,927 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml' 2025-11-27T00:44:09,929 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml' 2025-11-27T00:44:09,930 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml' 2025-11-27T00:44:09,931 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml' 2025-11-27T00:44:09,932 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml' 2025-11-27T00:44:09,933 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml' 2025-11-27T00:44:09,935 adding 'lm_eval/tasks/arithmetic/README.md' 2025-11-27T00:44:09,936 adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml' 2025-11-27T00:44:09,937 adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml' 2025-11-27T00:44:09,938 adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml' 2025-11-27T00:44:09,939 adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml' 2025-11-27T00:44:09,941 adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml' 2025-11-27T00:44:09,942 adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml' 2025-11-27T00:44:09,943 adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml' 2025-11-27T00:44:09,944 adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml' 2025-11-27T00:44:09,945 adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml' 2025-11-27T00:44:09,946 adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml' 2025-11-27T00:44:09,948 adding 'lm_eval/tasks/asdiv/README.md' 2025-11-27T00:44:09,950 adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml' 2025-11-27T00:44:09,951 adding 'lm_eval/tasks/asdiv/default.yaml' 2025-11-27T00:44:09,953 adding 'lm_eval/tasks/babi/README.md' 2025-11-27T00:44:09,954 adding 'lm_eval/tasks/babi/babi.yaml' 2025-11-27T00:44:09,957 adding 'lm_eval/tasks/babilong/README.md' 2025-11-27T00:44:09,958 adding 'lm_eval/tasks/babilong/_babilong_common_yaml' 2025-11-27T00:44:09,959 adding 'lm_eval/tasks/babilong/babilong.yaml' 2025-11-27T00:44:09,961 adding 'lm_eval/tasks/babilong/babilong_longctx.yaml' 2025-11-27T00:44:09,962 adding 'lm_eval/tasks/babilong/babilong_qa1.yaml' 2025-11-27T00:44:09,963 adding 'lm_eval/tasks/babilong/babilong_qa10.yaml' 2025-11-27T00:44:09,965 adding 'lm_eval/tasks/babilong/babilong_qa11.yaml' 2025-11-27T00:44:09,967 adding 'lm_eval/tasks/babilong/babilong_qa12.yaml' 2025-11-27T00:44:09,968 adding 'lm_eval/tasks/babilong/babilong_qa13.yaml' 2025-11-27T00:44:09,969 adding 'lm_eval/tasks/babilong/babilong_qa14.yaml' 2025-11-27T00:44:09,971 adding 'lm_eval/tasks/babilong/babilong_qa15.yaml' 2025-11-27T00:44:09,972 adding 'lm_eval/tasks/babilong/babilong_qa16.yaml' 2025-11-27T00:44:09,973 adding 'lm_eval/tasks/babilong/babilong_qa17.yaml' 2025-11-27T00:44:09,975 adding 'lm_eval/tasks/babilong/babilong_qa18.yaml' 2025-11-27T00:44:09,976 adding 'lm_eval/tasks/babilong/babilong_qa19.yaml' 2025-11-27T00:44:09,977 adding 'lm_eval/tasks/babilong/babilong_qa2.yaml' 2025-11-27T00:44:09,978 adding 'lm_eval/tasks/babilong/babilong_qa20.yaml' 2025-11-27T00:44:09,980 adding 'lm_eval/tasks/babilong/babilong_qa3.yaml' 2025-11-27T00:44:09,981 adding 'lm_eval/tasks/babilong/babilong_qa4.yaml' 2025-11-27T00:44:09,982 adding 'lm_eval/tasks/babilong/babilong_qa5.yaml' 2025-11-27T00:44:09,983 adding 'lm_eval/tasks/babilong/babilong_qa6.yaml' 2025-11-27T00:44:09,985 adding 'lm_eval/tasks/babilong/babilong_qa7.yaml' 2025-11-27T00:44:09,986 adding 'lm_eval/tasks/babilong/babilong_qa8.yaml' 2025-11-27T00:44:09,987 adding 'lm_eval/tasks/babilong/babilong_qa9.yaml' 2025-11-27T00:44:09,989 adding 'lm_eval/tasks/babilong/common_utils.py' 2025-11-27T00:44:09,990 adding 'lm_eval/tasks/bangla/README.md' 2025-11-27T00:44:09,992 adding 'lm_eval/tasks/bangla/bangla_mmlu_test.yaml' 2025-11-27T00:44:09,994 adding 'lm_eval/tasks/basque_bench/README.md' 2025-11-27T00:44:09,995 adding 'lm_eval/tasks/basque_bench/arc_eu_challenge.yaml' 2025-11-27T00:44:09,996 adding 'lm_eval/tasks/basque_bench/arc_eu_easy.yaml' 2025-11-27T00:44:09,998 adding 'lm_eval/tasks/basque_bench/basque_bench.yaml' 2025-11-27T00:44:09,999 adding 'lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml' 2025-11-27T00:44:10,001 adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml' 2025-11-27T00:44:10,002 adding 'lm_eval/tasks/basque_bench/paws_eu.yaml' 2025-11-27T00:44:10,003 adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml' 2025-11-27T00:44:10,004 adding 'lm_eval/tasks/basque_bench/utils.py' 2025-11-27T00:44:10,006 adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml' 2025-11-27T00:44:10,007 adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml' 2025-11-27T00:44:10,010 adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml' 2025-11-27T00:44:10,011 adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py' 2025-11-27T00:44:10,013 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml' 2025-11-27T00:44:10,014 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml' 2025-11-27T00:44:10,015 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml' 2025-11-27T00:44:10,016 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml' 2025-11-27T00:44:10,018 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml' 2025-11-27T00:44:10,019 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml' 2025-11-27T00:44:10,020 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml' 2025-11-27T00:44:10,021 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml' 2025-11-27T00:44:10,022 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml' 2025-11-27T00:44:10,023 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml' 2025-11-27T00:44:10,024 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml' 2025-11-27T00:44:10,025 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml' 2025-11-27T00:44:10,026 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml' 2025-11-27T00:44:10,028 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml' 2025-11-27T00:44:10,029 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml' 2025-11-27T00:44:10,030 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml' 2025-11-27T00:44:10,031 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml' 2025-11-27T00:44:10,033 adding 'lm_eval/tasks/basqueglue/README.md' 2025-11-27T00:44:10,035 adding 'lm_eval/tasks/basqueglue/bec.yaml' 2025-11-27T00:44:10,036 adding 'lm_eval/tasks/basqueglue/bhtc.yaml' 2025-11-27T00:44:10,037 adding 'lm_eval/tasks/basqueglue/coref.yaml' 2025-11-27T00:44:10,038 adding 'lm_eval/tasks/basqueglue/qnli.yaml' 2025-11-27T00:44:10,040 adding 'lm_eval/tasks/basqueglue/utils.py' 2025-11-27T00:44:10,041 adding 'lm_eval/tasks/basqueglue/vaxx.yaml' 2025-11-27T00:44:10,043 adding 'lm_eval/tasks/basqueglue/wic.yaml' 2025-11-27T00:44:10,045 adding 'lm_eval/tasks/bbh/README.md' 2025-11-27T00:44:10,046 adding 'lm_eval/tasks/bbh/_generate_configs.py' 2025-11-27T00:44:10,049 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml' 2025-11-27T00:44:10,051 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml' 2025-11-27T00:44:10,052 adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml' 2025-11-27T00:44:10,054 adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml' 2025-11-27T00:44:10,056 adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml' 2025-11-27T00:44:10,057 adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml' 2025-11-27T00:44:10,059 adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml' 2025-11-27T00:44:10,060 adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml' 2025-11-27T00:44:10,062 adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml' 2025-11-27T00:44:10,063 adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml' 2025-11-27T00:44:10,065 adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml' 2025-11-27T00:44:10,066 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml' 2025-11-27T00:44:10,067 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml' 2025-11-27T00:44:10,069 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml' 2025-11-27T00:44:10,070 adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml' 2025-11-27T00:44:10,071 adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml' 2025-11-27T00:44:10,073 adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml' 2025-11-27T00:44:10,074 adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml' 2025-11-27T00:44:10,075 adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml' 2025-11-27T00:44:10,076 adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,078 adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml' 2025-11-27T00:44:10,079 adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,081 adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml' 2025-11-27T00:44:10,082 adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml' 2025-11-27T00:44:10,084 adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml' 2025-11-27T00:44:10,085 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml' 2025-11-27T00:44:10,086 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml' 2025-11-27T00:44:10,088 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml' 2025-11-27T00:44:10,089 adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml' 2025-11-27T00:44:10,090 adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml' 2025-11-27T00:44:10,093 adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml' 2025-11-27T00:44:10,094 adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml' 2025-11-27T00:44:10,095 adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml' 2025-11-27T00:44:10,096 adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml' 2025-11-27T00:44:10,097 adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml' 2025-11-27T00:44:10,099 adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml' 2025-11-27T00:44:10,100 adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml' 2025-11-27T00:44:10,101 adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml' 2025-11-27T00:44:10,102 adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml' 2025-11-27T00:44:10,103 adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml' 2025-11-27T00:44:10,105 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml' 2025-11-27T00:44:10,106 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml' 2025-11-27T00:44:10,107 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml' 2025-11-27T00:44:10,108 adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml' 2025-11-27T00:44:10,110 adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml' 2025-11-27T00:44:10,111 adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml' 2025-11-27T00:44:10,112 adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml' 2025-11-27T00:44:10,114 adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml' 2025-11-27T00:44:10,115 adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,116 adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml' 2025-11-27T00:44:10,117 adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,118 adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml' 2025-11-27T00:44:10,120 adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml' 2025-11-27T00:44:10,121 adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml' 2025-11-27T00:44:10,122 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml' 2025-11-27T00:44:10,123 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2025-11-27T00:44:10,125 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml' 2025-11-27T00:44:10,126 adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py' 2025-11-27T00:44:10,128 adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml' 2025-11-27T00:44:10,129 adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml' 2025-11-27T00:44:10,131 adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml' 2025-11-27T00:44:10,132 adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml' 2025-11-27T00:44:10,133 adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml' 2025-11-27T00:44:10,134 adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml' 2025-11-27T00:44:10,136 adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml' 2025-11-27T00:44:10,137 adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml' 2025-11-27T00:44:10,138 adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml' 2025-11-27T00:44:10,139 adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml' 2025-11-27T00:44:10,141 adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml' 2025-11-27T00:44:10,142 adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml' 2025-11-27T00:44:10,143 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml' 2025-11-27T00:44:10,144 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml' 2025-11-27T00:44:10,146 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml' 2025-11-27T00:44:10,147 adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml' 2025-11-27T00:44:10,148 adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml' 2025-11-27T00:44:10,149 adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml' 2025-11-27T00:44:10,150 adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml' 2025-11-27T00:44:10,152 adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml' 2025-11-27T00:44:10,153 adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,154 adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml' 2025-11-27T00:44:10,156 adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,157 adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml' 2025-11-27T00:44:10,158 adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml' 2025-11-27T00:44:10,159 adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml' 2025-11-27T00:44:10,161 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml' 2025-11-27T00:44:10,162 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml' 2025-11-27T00:44:10,163 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml' 2025-11-27T00:44:10,165 adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml' 2025-11-27T00:44:10,166 adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml' 2025-11-27T00:44:10,168 adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml' 2025-11-27T00:44:10,169 adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml' 2025-11-27T00:44:10,171 adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml' 2025-11-27T00:44:10,172 adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml' 2025-11-27T00:44:10,173 adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml' 2025-11-27T00:44:10,174 adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml' 2025-11-27T00:44:10,175 adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml' 2025-11-27T00:44:10,177 adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml' 2025-11-27T00:44:10,178 adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml' 2025-11-27T00:44:10,179 adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml' 2025-11-27T00:44:10,180 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml' 2025-11-27T00:44:10,182 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml' 2025-11-27T00:44:10,183 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml' 2025-11-27T00:44:10,184 adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml' 2025-11-27T00:44:10,185 adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml' 2025-11-27T00:44:10,186 adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml' 2025-11-27T00:44:10,188 adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml' 2025-11-27T00:44:10,189 adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml' 2025-11-27T00:44:10,190 adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,191 adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml' 2025-11-27T00:44:10,192 adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,193 adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml' 2025-11-27T00:44:10,194 adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml' 2025-11-27T00:44:10,196 adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml' 2025-11-27T00:44:10,197 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml' 2025-11-27T00:44:10,198 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2025-11-27T00:44:10,199 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml' 2025-11-27T00:44:10,201 adding 'lm_eval/tasks/bbh/zeroshot/utils.py' 2025-11-27T00:44:10,202 adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml' 2025-11-27T00:44:10,203 adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml' 2025-11-27T00:44:10,205 adding 'lm_eval/tasks/bbq/README.md' 2025-11-27T00:44:10,207 adding 'lm_eval/tasks/bbq/bbq_generate.yaml' 2025-11-27T00:44:10,208 adding 'lm_eval/tasks/bbq/bbq_generate_ambig.yaml' 2025-11-27T00:44:10,209 adding 'lm_eval/tasks/bbq/bbq_generate_disambig.yaml' 2025-11-27T00:44:10,210 adding 'lm_eval/tasks/bbq/bbq_multiple_choice.yaml' 2025-11-27T00:44:10,211 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml' 2025-11-27T00:44:10,212 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml' 2025-11-27T00:44:10,215 adding 'lm_eval/tasks/bbq/utils.py' 2025-11-27T00:44:10,219 adding 'lm_eval/tasks/belebele/README.md' 2025-11-27T00:44:10,220 adding 'lm_eval/tasks/belebele/_belebele.yaml' 2025-11-27T00:44:10,221 adding 'lm_eval/tasks/belebele/_default_template_yaml' 2025-11-27T00:44:10,223 adding 'lm_eval/tasks/belebele/_generate_configs.py' 2025-11-27T00:44:10,224 adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml' 2025-11-27T00:44:10,225 adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml' 2025-11-27T00:44:10,226 adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml' 2025-11-27T00:44:10,227 adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml' 2025-11-27T00:44:10,228 adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml' 2025-11-27T00:44:10,229 adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml' 2025-11-27T00:44:10,231 adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml' 2025-11-27T00:44:10,232 adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml' 2025-11-27T00:44:10,233 adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml' 2025-11-27T00:44:10,234 adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml' 2025-11-27T00:44:10,235 adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml' 2025-11-27T00:44:10,236 adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml' 2025-11-27T00:44:10,238 adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml' 2025-11-27T00:44:10,239 adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml' 2025-11-27T00:44:10,240 adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml' 2025-11-27T00:44:10,241 adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml' 2025-11-27T00:44:10,242 adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml' 2025-11-27T00:44:10,243 adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml' 2025-11-27T00:44:10,245 adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml' 2025-11-27T00:44:10,246 adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml' 2025-11-27T00:44:10,247 adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml' 2025-11-27T00:44:10,248 adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml' 2025-11-27T00:44:10,249 adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml' 2025-11-27T00:44:10,250 adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml' 2025-11-27T00:44:10,251 adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml' 2025-11-27T00:44:10,252 adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml' 2025-11-27T00:44:10,253 adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml' 2025-11-27T00:44:10,255 adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml' 2025-11-27T00:44:10,256 adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml' 2025-11-27T00:44:10,257 adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml' 2025-11-27T00:44:10,258 adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml' 2025-11-27T00:44:10,259 adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml' 2025-11-27T00:44:10,260 adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml' 2025-11-27T00:44:10,261 adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml' 2025-11-27T00:44:10,262 adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml' 2025-11-27T00:44:10,264 adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml' 2025-11-27T00:44:10,265 adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml' 2025-11-27T00:44:10,266 adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml' 2025-11-27T00:44:10,267 adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml' 2025-11-27T00:44:10,268 adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml' 2025-11-27T00:44:10,269 adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml' 2025-11-27T00:44:10,270 adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml' 2025-11-27T00:44:10,271 adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml' 2025-11-27T00:44:10,272 adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml' 2025-11-27T00:44:10,274 adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml' 2025-11-27T00:44:10,275 adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml' 2025-11-27T00:44:10,276 adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml' 2025-11-27T00:44:10,277 adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml' 2025-11-27T00:44:10,278 adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml' 2025-11-27T00:44:10,279 adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml' 2025-11-27T00:44:10,280 adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml' 2025-11-27T00:44:10,282 adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml' 2025-11-27T00:44:10,283 adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml' 2025-11-27T00:44:10,284 adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml' 2025-11-27T00:44:10,285 adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml' 2025-11-27T00:44:10,286 adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml' 2025-11-27T00:44:10,287 adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml' 2025-11-27T00:44:10,288 adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml' 2025-11-27T00:44:10,290 adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml' 2025-11-27T00:44:10,291 adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml' 2025-11-27T00:44:10,292 adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml' 2025-11-27T00:44:10,293 adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml' 2025-11-27T00:44:10,294 adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml' 2025-11-27T00:44:10,295 adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml' 2025-11-27T00:44:10,296 adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml' 2025-11-27T00:44:10,298 adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml' 2025-11-27T00:44:10,299 adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml' 2025-11-27T00:44:10,300 adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml' 2025-11-27T00:44:10,301 adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml' 2025-11-27T00:44:10,302 adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml' 2025-11-27T00:44:10,303 adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml' 2025-11-27T00:44:10,305 adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml' 2025-11-27T00:44:10,306 adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml' 2025-11-27T00:44:10,307 adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml' 2025-11-27T00:44:10,308 adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml' 2025-11-27T00:44:10,309 adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml' 2025-11-27T00:44:10,310 adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml' 2025-11-27T00:44:10,311 adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml' 2025-11-27T00:44:10,312 adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml' 2025-11-27T00:44:10,313 adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml' 2025-11-27T00:44:10,314 adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml' 2025-11-27T00:44:10,315 adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml' 2025-11-27T00:44:10,317 adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml' 2025-11-27T00:44:10,318 adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml' 2025-11-27T00:44:10,319 adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml' 2025-11-27T00:44:10,320 adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml' 2025-11-27T00:44:10,321 adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml' 2025-11-27T00:44:10,323 adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml' 2025-11-27T00:44:10,324 adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml' 2025-11-27T00:44:10,325 adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml' 2025-11-27T00:44:10,326 adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml' 2025-11-27T00:44:10,327 adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml' 2025-11-27T00:44:10,328 adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml' 2025-11-27T00:44:10,329 adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml' 2025-11-27T00:44:10,330 adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml' 2025-11-27T00:44:10,331 adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml' 2025-11-27T00:44:10,333 adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml' 2025-11-27T00:44:10,334 adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml' 2025-11-27T00:44:10,335 adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml' 2025-11-27T00:44:10,336 adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml' 2025-11-27T00:44:10,337 adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml' 2025-11-27T00:44:10,338 adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml' 2025-11-27T00:44:10,339 adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml' 2025-11-27T00:44:10,341 adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml' 2025-11-27T00:44:10,342 adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml' 2025-11-27T00:44:10,343 adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml' 2025-11-27T00:44:10,344 adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml' 2025-11-27T00:44:10,345 adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml' 2025-11-27T00:44:10,346 adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml' 2025-11-27T00:44:10,347 adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml' 2025-11-27T00:44:10,349 adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml' 2025-11-27T00:44:10,350 adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml' 2025-11-27T00:44:10,351 adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml' 2025-11-27T00:44:10,352 adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml' 2025-11-27T00:44:10,353 adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml' 2025-11-27T00:44:10,354 adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml' 2025-11-27T00:44:10,355 adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml' 2025-11-27T00:44:10,357 adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml' 2025-11-27T00:44:10,358 adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml' 2025-11-27T00:44:10,359 adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml' 2025-11-27T00:44:10,361 adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml' 2025-11-27T00:44:10,362 adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml' 2025-11-27T00:44:10,364 adding 'lm_eval/tasks/benchmarks/README.md' 2025-11-27T00:44:10,365 adding 'lm_eval/tasks/benchmarks/minerva_math.yaml' 2025-11-27T00:44:10,366 adding 'lm_eval/tasks/benchmarks/openllm.yaml' 2025-11-27T00:44:10,367 adding 'lm_eval/tasks/benchmarks/pythia.yaml' 2025-11-27T00:44:10,368 adding 'lm_eval/tasks/benchmarks/t0_eval.yaml' 2025-11-27T00:44:10,370 adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml' 2025-11-27T00:44:10,371 adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml' 2025-11-27T00:44:10,373 adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml' 2025-11-27T00:44:10,374 adding 'lm_eval/tasks/benchmarks/multimedqa/README.md' 2025-11-27T00:44:10,376 adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml' 2025-11-27T00:44:10,378 adding 'lm_eval/tasks/bertaqa/README.md' 2025-11-27T00:44:10,379 adding 'lm_eval/tasks/bertaqa/_bertaqa_template' 2025-11-27T00:44:10,380 adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml' 2025-11-27T00:44:10,381 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml' 2025-11-27T00:44:10,382 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml' 2025-11-27T00:44:10,384 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml' 2025-11-27T00:44:10,385 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml' 2025-11-27T00:44:10,386 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml' 2025-11-27T00:44:10,387 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml' 2025-11-27T00:44:10,388 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml' 2025-11-27T00:44:10,389 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml' 2025-11-27T00:44:10,391 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml' 2025-11-27T00:44:10,392 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml' 2025-11-27T00:44:10,393 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml' 2025-11-27T00:44:10,394 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml' 2025-11-27T00:44:10,395 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml' 2025-11-27T00:44:10,396 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml' 2025-11-27T00:44:10,398 adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml' 2025-11-27T00:44:10,400 adding 'lm_eval/tasks/bhs/README.md' 2025-11-27T00:44:10,401 adding 'lm_eval/tasks/bhs/_template_yaml' 2025-11-27T00:44:10,403 adding 'lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml' 2025-11-27T00:44:10,404 adding 'lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml' 2025-11-27T00:44:10,405 adding 'lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml' 2025-11-27T00:44:10,406 adding 'lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml' 2025-11-27T00:44:10,407 adding 'lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml' 2025-11-27T00:44:10,408 adding 'lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml' 2025-11-27T00:44:10,409 adding 'lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml' 2025-11-27T00:44:10,411 adding 'lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml' 2025-11-27T00:44:10,412 adding 'lm_eval/tasks/bhs/bhs_basque.yaml' 2025-11-27T00:44:10,413 adding 'lm_eval/tasks/bhs/bhs_hindi.yaml' 2025-11-27T00:44:10,414 adding 'lm_eval/tasks/bhs/bhs_swahili.yaml' 2025-11-27T00:44:10,415 adding 'lm_eval/tasks/bhs/hindi-S_O_V.yaml' 2025-11-27T00:44:10,416 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml' 2025-11-27T00:44:10,417 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml' 2025-11-27T00:44:10,419 adding 'lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml' 2025-11-27T00:44:10,420 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml' 2025-11-27T00:44:10,421 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml' 2025-11-27T00:44:10,422 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml' 2025-11-27T00:44:10,423 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml' 2025-11-27T00:44:10,424 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml' 2025-11-27T00:44:10,426 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml' 2025-11-27T00:44:10,427 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml' 2025-11-27T00:44:10,428 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml' 2025-11-27T00:44:10,429 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml' 2025-11-27T00:44:10,430 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml' 2025-11-27T00:44:10,433 adding 'lm_eval/tasks/bigbench/README.md' 2025-11-27T00:44:10,434 adding 'lm_eval/tasks/bigbench/generate_tasks.py' 2025-11-27T00:44:10,435 adding 'lm_eval/tasks/bigbench/generate_until_template_yaml' 2025-11-27T00:44:10,437 adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml' 2025-11-27T00:44:10,438 adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml' 2025-11-27T00:44:10,439 adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py' 2025-11-27T00:44:10,444 adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml' 2025-11-27T00:44:10,445 adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml' 2025-11-27T00:44:10,446 adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml' 2025-11-27T00:44:10,448 adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml' 2025-11-27T00:44:10,449 adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml' 2025-11-27T00:44:10,450 adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml' 2025-11-27T00:44:10,451 adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml' 2025-11-27T00:44:10,452 adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml' 2025-11-27T00:44:10,453 adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml' 2025-11-27T00:44:10,454 adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml' 2025-11-27T00:44:10,455 adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml' 2025-11-27T00:44:10,457 adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml' 2025-11-27T00:44:10,458 adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml' 2025-11-27T00:44:10,459 adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml' 2025-11-27T00:44:10,460 adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml' 2025-11-27T00:44:10,461 adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml' 2025-11-27T00:44:10,462 adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml' 2025-11-27T00:44:10,463 adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml' 2025-11-27T00:44:10,464 adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml' 2025-11-27T00:44:10,466 adding 'lm_eval/tasks/bigbench/generate_until/color.yaml' 2025-11-27T00:44:10,467 adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml' 2025-11-27T00:44:10,468 adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml' 2025-11-27T00:44:10,469 adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml' 2025-11-27T00:44:10,470 adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml' 2025-11-27T00:44:10,471 adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml' 2025-11-27T00:44:10,473 adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml' 2025-11-27T00:44:10,474 adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml' 2025-11-27T00:44:10,475 adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml' 2025-11-27T00:44:10,476 adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml' 2025-11-27T00:44:10,477 adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml' 2025-11-27T00:44:10,478 adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml' 2025-11-27T00:44:10,480 adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml' 2025-11-27T00:44:10,481 adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml' 2025-11-27T00:44:10,482 adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml' 2025-11-27T00:44:10,483 adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml' 2025-11-27T00:44:10,484 adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml' 2025-11-27T00:44:10,485 adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml' 2025-11-27T00:44:10,486 adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml' 2025-11-27T00:44:10,487 adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml' 2025-11-27T00:44:10,488 adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml' 2025-11-27T00:44:10,489 adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml' 2025-11-27T00:44:10,491 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml' 2025-11-27T00:44:10,492 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml' 2025-11-27T00:44:10,493 adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml' 2025-11-27T00:44:10,494 adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml' 2025-11-27T00:44:10,495 adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml' 2025-11-27T00:44:10,496 adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml' 2025-11-27T00:44:10,497 adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml' 2025-11-27T00:44:10,499 adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml' 2025-11-27T00:44:10,500 adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml' 2025-11-27T00:44:10,501 adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml' 2025-11-27T00:44:10,502 adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml' 2025-11-27T00:44:10,503 adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml' 2025-11-27T00:44:10,504 adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml' 2025-11-27T00:44:10,505 adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml' 2025-11-27T00:44:10,506 adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml' 2025-11-27T00:44:10,508 adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml' 2025-11-27T00:44:10,509 adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml' 2025-11-27T00:44:10,510 adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml' 2025-11-27T00:44:10,511 adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml' 2025-11-27T00:44:10,512 adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml' 2025-11-27T00:44:10,513 adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml' 2025-11-27T00:44:10,514 adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml' 2025-11-27T00:44:10,516 adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml' 2025-11-27T00:44:10,517 adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml' 2025-11-27T00:44:10,518 adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml' 2025-11-27T00:44:10,519 adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml' 2025-11-27T00:44:10,520 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml' 2025-11-27T00:44:10,521 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml' 2025-11-27T00:44:10,523 adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml' 2025-11-27T00:44:10,524 adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml' 2025-11-27T00:44:10,525 adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml' 2025-11-27T00:44:10,526 adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml' 2025-11-27T00:44:10,527 adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml' 2025-11-27T00:44:10,528 adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml' 2025-11-27T00:44:10,530 adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml' 2025-11-27T00:44:10,531 adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml' 2025-11-27T00:44:10,532 adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml' 2025-11-27T00:44:10,533 adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml' 2025-11-27T00:44:10,534 adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml' 2025-11-27T00:44:10,535 adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml' 2025-11-27T00:44:10,536 adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml' 2025-11-27T00:44:10,537 adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml' 2025-11-27T00:44:10,539 adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml' 2025-11-27T00:44:10,540 adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml' 2025-11-27T00:44:10,541 adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml' 2025-11-27T00:44:10,542 adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml' 2025-11-27T00:44:10,543 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml' 2025-11-27T00:44:10,544 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml' 2025-11-27T00:44:10,546 adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml' 2025-11-27T00:44:10,547 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml' 2025-11-27T00:44:10,548 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml' 2025-11-27T00:44:10,549 adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml' 2025-11-27T00:44:10,550 adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml' 2025-11-27T00:44:10,551 adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml' 2025-11-27T00:44:10,552 adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml' 2025-11-27T00:44:10,553 adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml' 2025-11-27T00:44:10,555 adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml' 2025-11-27T00:44:10,556 adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml' 2025-11-27T00:44:10,557 adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml' 2025-11-27T00:44:10,558 adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml' 2025-11-27T00:44:10,559 adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml' 2025-11-27T00:44:10,560 adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml' 2025-11-27T00:44:10,562 adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml' 2025-11-27T00:44:10,563 adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml' 2025-11-27T00:44:10,564 adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml' 2025-11-27T00:44:10,565 adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml' 2025-11-27T00:44:10,566 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml' 2025-11-27T00:44:10,567 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml' 2025-11-27T00:44:10,569 adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml' 2025-11-27T00:44:10,570 adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml' 2025-11-27T00:44:10,571 adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml' 2025-11-27T00:44:10,572 adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml' 2025-11-27T00:44:10,573 adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml' 2025-11-27T00:44:10,574 adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml' 2025-11-27T00:44:10,576 adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml' 2025-11-27T00:44:10,577 adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml' 2025-11-27T00:44:10,578 adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml' 2025-11-27T00:44:10,579 adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml' 2025-11-27T00:44:10,580 adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml' 2025-11-27T00:44:10,581 adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml' 2025-11-27T00:44:10,583 adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml' 2025-11-27T00:44:10,584 adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,585 adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml' 2025-11-27T00:44:10,586 adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml' 2025-11-27T00:44:10,587 adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml' 2025-11-27T00:44:10,588 adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml' 2025-11-27T00:44:10,589 adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,590 adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml' 2025-11-27T00:44:10,591 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml' 2025-11-27T00:44:10,593 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml' 2025-11-27T00:44:10,594 adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml' 2025-11-27T00:44:10,595 adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml' 2025-11-27T00:44:10,596 adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml' 2025-11-27T00:44:10,597 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml' 2025-11-27T00:44:10,598 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml' 2025-11-27T00:44:10,599 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml' 2025-11-27T00:44:10,600 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml' 2025-11-27T00:44:10,602 adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml' 2025-11-27T00:44:10,603 adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml' 2025-11-27T00:44:10,604 adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml' 2025-11-27T00:44:10,605 adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml' 2025-11-27T00:44:10,606 adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml' 2025-11-27T00:44:10,607 adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml' 2025-11-27T00:44:10,608 adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml' 2025-11-27T00:44:10,610 adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml' 2025-11-27T00:44:10,611 adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml' 2025-11-27T00:44:10,612 adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml' 2025-11-27T00:44:10,613 adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml' 2025-11-27T00:44:10,614 adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml' 2025-11-27T00:44:10,615 adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml' 2025-11-27T00:44:10,617 adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml' 2025-11-27T00:44:10,618 adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml' 2025-11-27T00:44:10,619 adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml' 2025-11-27T00:44:10,620 adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml' 2025-11-27T00:44:10,621 adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml' 2025-11-27T00:44:10,622 adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml' 2025-11-27T00:44:10,624 adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml' 2025-11-27T00:44:10,625 adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml' 2025-11-27T00:44:10,626 adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml' 2025-11-27T00:44:10,627 adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml' 2025-11-27T00:44:10,628 adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml' 2025-11-27T00:44:10,629 adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml' 2025-11-27T00:44:10,631 adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml' 2025-11-27T00:44:10,632 adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml' 2025-11-27T00:44:10,633 adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml' 2025-11-27T00:44:10,634 adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml' 2025-11-27T00:44:10,638 adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml' 2025-11-27T00:44:10,639 adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml' 2025-11-27T00:44:10,640 adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml' 2025-11-27T00:44:10,641 adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml' 2025-11-27T00:44:10,643 adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml' 2025-11-27T00:44:10,644 adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml' 2025-11-27T00:44:10,645 adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml' 2025-11-27T00:44:10,646 adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml' 2025-11-27T00:44:10,647 adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml' 2025-11-27T00:44:10,648 adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml' 2025-11-27T00:44:10,649 adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml' 2025-11-27T00:44:10,651 adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml' 2025-11-27T00:44:10,652 adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml' 2025-11-27T00:44:10,653 adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml' 2025-11-27T00:44:10,654 adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml' 2025-11-27T00:44:10,655 adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml' 2025-11-27T00:44:10,656 adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml' 2025-11-27T00:44:10,657 adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml' 2025-11-27T00:44:10,658 adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml' 2025-11-27T00:44:10,660 adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml' 2025-11-27T00:44:10,661 adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml' 2025-11-27T00:44:10,662 adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml' 2025-11-27T00:44:10,663 adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml' 2025-11-27T00:44:10,664 adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml' 2025-11-27T00:44:10,665 adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml' 2025-11-27T00:44:10,667 adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml' 2025-11-27T00:44:10,668 adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml' 2025-11-27T00:44:10,669 adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml' 2025-11-27T00:44:10,670 adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml' 2025-11-27T00:44:10,671 adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml' 2025-11-27T00:44:10,673 adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml' 2025-11-27T00:44:10,674 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml' 2025-11-27T00:44:10,675 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml' 2025-11-27T00:44:10,676 adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml' 2025-11-27T00:44:10,677 adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml' 2025-11-27T00:44:10,679 adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml' 2025-11-27T00:44:10,680 adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml' 2025-11-27T00:44:10,681 adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml' 2025-11-27T00:44:10,682 adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml' 2025-11-27T00:44:10,683 adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml' 2025-11-27T00:44:10,684 adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml' 2025-11-27T00:44:10,685 adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml' 2025-11-27T00:44:10,686 adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml' 2025-11-27T00:44:10,687 adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml' 2025-11-27T00:44:10,689 adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml' 2025-11-27T00:44:10,690 adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml' 2025-11-27T00:44:10,691 adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml' 2025-11-27T00:44:10,692 adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml' 2025-11-27T00:44:10,693 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml' 2025-11-27T00:44:10,694 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml' 2025-11-27T00:44:10,695 adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml' 2025-11-27T00:44:10,696 adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml' 2025-11-27T00:44:10,698 adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml' 2025-11-27T00:44:10,699 adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml' 2025-11-27T00:44:10,700 adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml' 2025-11-27T00:44:10,701 adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml' 2025-11-27T00:44:10,702 adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml' 2025-11-27T00:44:10,703 adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml' 2025-11-27T00:44:10,704 adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml' 2025-11-27T00:44:10,705 adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml' 2025-11-27T00:44:10,707 adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml' 2025-11-27T00:44:10,708 adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml' 2025-11-27T00:44:10,709 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml' 2025-11-27T00:44:10,710 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml' 2025-11-27T00:44:10,711 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml' 2025-11-27T00:44:10,713 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml' 2025-11-27T00:44:10,714 adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml' 2025-11-27T00:44:10,715 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml' 2025-11-27T00:44:10,716 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml' 2025-11-27T00:44:10,717 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml' 2025-11-27T00:44:10,718 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml' 2025-11-27T00:44:10,720 adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml' 2025-11-27T00:44:10,721 adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml' 2025-11-27T00:44:10,722 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml' 2025-11-27T00:44:10,723 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml' 2025-11-27T00:44:10,724 adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml' 2025-11-27T00:44:10,726 adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml' 2025-11-27T00:44:10,727 adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml' 2025-11-27T00:44:10,728 adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml' 2025-11-27T00:44:10,729 adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml' 2025-11-27T00:44:10,730 adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml' 2025-11-27T00:44:10,731 adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml' 2025-11-27T00:44:10,732 adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml' 2025-11-27T00:44:10,733 adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml' 2025-11-27T00:44:10,735 adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml' 2025-11-27T00:44:10,736 adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml' 2025-11-27T00:44:10,737 adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml' 2025-11-27T00:44:10,738 adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml' 2025-11-27T00:44:10,739 adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml' 2025-11-27T00:44:10,741 adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml' 2025-11-27T00:44:10,742 adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml' 2025-11-27T00:44:10,743 adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:10,744 adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml' 2025-11-27T00:44:10,745 adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml' 2025-11-27T00:44:10,746 adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml' 2025-11-27T00:44:10,747 adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml' 2025-11-27T00:44:10,749 adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml' 2025-11-27T00:44:10,750 adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml' 2025-11-27T00:44:10,751 adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml' 2025-11-27T00:44:10,752 adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml' 2025-11-27T00:44:10,753 adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml' 2025-11-27T00:44:10,755 adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml' 2025-11-27T00:44:10,756 adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml' 2025-11-27T00:44:10,757 adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml' 2025-11-27T00:44:10,758 adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml' 2025-11-27T00:44:10,760 adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml' 2025-11-27T00:44:10,761 adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml' 2025-11-27T00:44:10,762 adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml' 2025-11-27T00:44:10,763 adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml' 2025-11-27T00:44:10,764 adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml' 2025-11-27T00:44:10,766 adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml' 2025-11-27T00:44:10,767 adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml' 2025-11-27T00:44:10,768 adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml' 2025-11-27T00:44:10,769 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml' 2025-11-27T00:44:10,770 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml' 2025-11-27T00:44:10,772 adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml' 2025-11-27T00:44:10,773 adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml' 2025-11-27T00:44:10,774 adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml' 2025-11-27T00:44:10,775 adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml' 2025-11-27T00:44:10,779 adding 'lm_eval/tasks/blimp/README.md' 2025-11-27T00:44:10,780 adding 'lm_eval/tasks/blimp/_blimp.yaml' 2025-11-27T00:44:10,781 adding 'lm_eval/tasks/blimp/_template_yaml' 2025-11-27T00:44:10,782 adding 'lm_eval/tasks/blimp/adjunct_island.yaml' 2025-11-27T00:44:10,783 adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml' 2025-11-27T00:44:10,784 adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml' 2025-11-27T00:44:10,785 adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml' 2025-11-27T00:44:10,786 adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml' 2025-11-27T00:44:10,787 adding 'lm_eval/tasks/blimp/causative.yaml' 2025-11-27T00:44:10,789 adding 'lm_eval/tasks/blimp/complex_NP_island.yaml' 2025-11-27T00:44:10,790 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml' 2025-11-27T00:44:10,791 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml' 2025-11-27T00:44:10,792 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml' 2025-11-27T00:44:10,793 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml' 2025-11-27T00:44:10,794 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml' 2025-11-27T00:44:10,795 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml' 2025-11-27T00:44:10,796 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml' 2025-11-27T00:44:10,798 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml' 2025-11-27T00:44:10,799 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml' 2025-11-27T00:44:10,800 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml' 2025-11-27T00:44:10,801 adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml' 2025-11-27T00:44:10,802 adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml' 2025-11-27T00:44:10,803 adding 'lm_eval/tasks/blimp/drop_argument.yaml' 2025-11-27T00:44:10,804 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml' 2025-11-27T00:44:10,806 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml' 2025-11-27T00:44:10,807 adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml' 2025-11-27T00:44:10,808 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml' 2025-11-27T00:44:10,809 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml' 2025-11-27T00:44:10,810 adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml' 2025-11-27T00:44:10,811 adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml' 2025-11-27T00:44:10,813 adding 'lm_eval/tasks/blimp/generate_configs.py' 2025-11-27T00:44:10,814 adding 'lm_eval/tasks/blimp/inchoative.yaml' 2025-11-27T00:44:10,815 adding 'lm_eval/tasks/blimp/intransitive.yaml' 2025-11-27T00:44:10,816 adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml' 2025-11-27T00:44:10,817 adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml' 2025-11-27T00:44:10,818 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml' 2025-11-27T00:44:10,820 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml' 2025-11-27T00:44:10,821 adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml' 2025-11-27T00:44:10,822 adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml' 2025-11-27T00:44:10,823 adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml' 2025-11-27T00:44:10,824 adding 'lm_eval/tasks/blimp/npi_present_1.yaml' 2025-11-27T00:44:10,825 adding 'lm_eval/tasks/blimp/npi_present_2.yaml' 2025-11-27T00:44:10,826 adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml' 2025-11-27T00:44:10,828 adding 'lm_eval/tasks/blimp/only_npi_scope.yaml' 2025-11-27T00:44:10,829 adding 'lm_eval/tasks/blimp/passive_1.yaml' 2025-11-27T00:44:10,830 adding 'lm_eval/tasks/blimp/passive_2.yaml' 2025-11-27T00:44:10,831 adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml' 2025-11-27T00:44:10,832 adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml' 2025-11-27T00:44:10,833 adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml' 2025-11-27T00:44:10,834 adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml' 2025-11-27T00:44:10,835 adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml' 2025-11-27T00:44:10,836 adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml' 2025-11-27T00:44:10,837 adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml' 2025-11-27T00:44:10,838 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml' 2025-11-27T00:44:10,840 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml' 2025-11-27T00:44:10,841 adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml' 2025-11-27T00:44:10,842 adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml' 2025-11-27T00:44:10,843 adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml' 2025-11-27T00:44:10,844 adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml' 2025-11-27T00:44:10,845 adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml' 2025-11-27T00:44:10,846 adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml' 2025-11-27T00:44:10,847 adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml' 2025-11-27T00:44:10,848 adding 'lm_eval/tasks/blimp/transitive.yaml' 2025-11-27T00:44:10,850 adding 'lm_eval/tasks/blimp/wh_island.yaml' 2025-11-27T00:44:10,851 adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml' 2025-11-27T00:44:10,852 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml' 2025-11-27T00:44:10,853 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml' 2025-11-27T00:44:10,854 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml' 2025-11-27T00:44:10,855 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml' 2025-11-27T00:44:10,856 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml' 2025-11-27T00:44:10,857 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml' 2025-11-27T00:44:10,861 adding 'lm_eval/tasks/blimp_nl/README.md' 2025-11-27T00:44:10,862 adding 'lm_eval/tasks/blimp_nl/_template_yaml' 2025-11-27T00:44:10,863 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml' 2025-11-27T00:44:10,865 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml' 2025-11-27T00:44:10,866 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml' 2025-11-27T00:44:10,867 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml' 2025-11-27T00:44:10,868 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml' 2025-11-27T00:44:10,869 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml' 2025-11-27T00:44:10,870 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml' 2025-11-27T00:44:10,871 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml' 2025-11-27T00:44:10,872 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml' 2025-11-27T00:44:10,874 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml' 2025-11-27T00:44:10,875 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml' 2025-11-27T00:44:10,876 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml' 2025-11-27T00:44:10,877 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml' 2025-11-27T00:44:10,878 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml' 2025-11-27T00:44:10,879 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml' 2025-11-27T00:44:10,881 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml' 2025-11-27T00:44:10,882 adding 'lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml' 2025-11-27T00:44:10,883 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml' 2025-11-27T00:44:10,884 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml' 2025-11-27T00:44:10,885 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml' 2025-11-27T00:44:10,886 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml' 2025-11-27T00:44:10,888 adding 'lm_eval/tasks/blimp_nl/blimp_nl_group.yaml' 2025-11-27T00:44:10,889 adding 'lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml' 2025-11-27T00:44:10,890 adding 'lm_eval/tasks/blimp_nl/complementive__intransitive.yaml' 2025-11-27T00:44:10,891 adding 'lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml' 2025-11-27T00:44:10,892 adding 'lm_eval/tasks/blimp_nl/complementive__position_verb.yaml' 2025-11-27T00:44:10,893 adding 'lm_eval/tasks/blimp_nl/complementive__transitive.yaml' 2025-11-27T00:44:10,894 adding 'lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml' 2025-11-27T00:44:10,895 adding 'lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml' 2025-11-27T00:44:10,896 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml' 2025-11-27T00:44:10,897 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml' 2025-11-27T00:44:10,899 adding 'lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml' 2025-11-27T00:44:10,900 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml' 2025-11-27T00:44:10,901 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml' 2025-11-27T00:44:10,902 adding 'lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml' 2025-11-27T00:44:10,903 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml' 2025-11-27T00:44:10,904 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml' 2025-11-27T00:44:10,905 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml' 2025-11-27T00:44:10,906 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml' 2025-11-27T00:44:10,907 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml' 2025-11-27T00:44:10,908 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml' 2025-11-27T00:44:10,910 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml' 2025-11-27T00:44:10,911 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml' 2025-11-27T00:44:10,912 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml' 2025-11-27T00:44:10,913 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml' 2025-11-27T00:44:10,914 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml' 2025-11-27T00:44:10,915 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml' 2025-11-27T00:44:10,916 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml' 2025-11-27T00:44:10,918 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml' 2025-11-27T00:44:10,919 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml' 2025-11-27T00:44:10,920 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml' 2025-11-27T00:44:10,921 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml' 2025-11-27T00:44:10,922 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml' 2025-11-27T00:44:10,923 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml' 2025-11-27T00:44:10,924 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml' 2025-11-27T00:44:10,926 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml' 2025-11-27T00:44:10,927 adding 'lm_eval/tasks/blimp_nl/passive__aci.yaml' 2025-11-27T00:44:10,928 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml' 2025-11-27T00:44:10,929 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml' 2025-11-27T00:44:10,930 adding 'lm_eval/tasks/blimp_nl/passive__impersonal.yaml' 2025-11-27T00:44:10,931 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml' 2025-11-27T00:44:10,932 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml' 2025-11-27T00:44:10,934 adding 'lm_eval/tasks/blimp_nl/r_words__adverbial.yaml' 2025-11-27T00:44:10,934 adding 'lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml' 2025-11-27T00:44:10,936 adding 'lm_eval/tasks/blimp_nl/relativization__island.yaml' 2025-11-27T00:44:10,937 adding 'lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml' 2025-11-27T00:44:10,938 adding 'lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml' 2025-11-27T00:44:10,939 adding 'lm_eval/tasks/blimp_nl/topicalization__island.yaml' 2025-11-27T00:44:10,940 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml' 2025-11-27T00:44:10,941 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml' 2025-11-27T00:44:10,942 adding 'lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml' 2025-11-27T00:44:10,943 adding 'lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml' 2025-11-27T00:44:10,944 adding 'lm_eval/tasks/blimp_nl/verb_second__order_main.yaml' 2025-11-27T00:44:10,946 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml' 2025-11-27T00:44:10,947 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml' 2025-11-27T00:44:10,948 adding 'lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml' 2025-11-27T00:44:10,949 adding 'lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml' 2025-11-27T00:44:10,950 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml' 2025-11-27T00:44:10,951 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml' 2025-11-27T00:44:10,952 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml' 2025-11-27T00:44:10,953 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml' 2025-11-27T00:44:10,954 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml' 2025-11-27T00:44:10,956 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml' 2025-11-27T00:44:10,957 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml' 2025-11-27T00:44:10,958 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml' 2025-11-27T00:44:10,960 adding 'lm_eval/tasks/c4/README.md' 2025-11-27T00:44:10,961 adding 'lm_eval/tasks/c4/c4.yaml' 2025-11-27T00:44:10,962 adding 'lm_eval/tasks/c4/preprocess_c4.py' 2025-11-27T00:44:10,964 adding 'lm_eval/tasks/cabbq/README.md' 2025-11-27T00:44:10,966 adding 'lm_eval/tasks/cabbq/_cabbq_common_yaml' 2025-11-27T00:44:10,967 adding 'lm_eval/tasks/cabbq/cabbq.yaml' 2025-11-27T00:44:10,968 adding 'lm_eval/tasks/cabbq/cabbq_age.yaml' 2025-11-27T00:44:10,969 adding 'lm_eval/tasks/cabbq/cabbq_disability_status.yaml' 2025-11-27T00:44:10,970 adding 'lm_eval/tasks/cabbq/cabbq_gender.yaml' 2025-11-27T00:44:10,971 adding 'lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml' 2025-11-27T00:44:10,972 adding 'lm_eval/tasks/cabbq/cabbq_nationality.yaml' 2025-11-27T00:44:10,974 adding 'lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml' 2025-11-27T00:44:10,975 adding 'lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml' 2025-11-27T00:44:10,976 adding 'lm_eval/tasks/cabbq/cabbq_religion.yaml' 2025-11-27T00:44:10,977 adding 'lm_eval/tasks/cabbq/cabbq_ses.yaml' 2025-11-27T00:44:10,978 adding 'lm_eval/tasks/cabbq/cabbq_spanish_region.yaml' 2025-11-27T00:44:10,980 adding 'lm_eval/tasks/cabbq/utils.py' 2025-11-27T00:44:10,982 adding 'lm_eval/tasks/careqa/README.md' 2025-11-27T00:44:10,983 adding 'lm_eval/tasks/careqa/careqa_en.yaml' 2025-11-27T00:44:10,984 adding 'lm_eval/tasks/careqa/careqa_es.yaml' 2025-11-27T00:44:10,985 adding 'lm_eval/tasks/careqa/careqa_open.yaml' 2025-11-27T00:44:10,987 adding 'lm_eval/tasks/careqa/careqa_open_perplexity.yaml' 2025-11-27T00:44:10,988 adding 'lm_eval/tasks/careqa/utils.py' 2025-11-27T00:44:10,989 adding 'lm_eval/tasks/careqa/utils_open.py' 2025-11-27T00:44:10,990 adding 'lm_eval/tasks/careqa/utils_perplexity.py' 2025-11-27T00:44:10,993 adding 'lm_eval/tasks/catalan_bench/README.md' 2025-11-27T00:44:10,994 adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml' 2025-11-27T00:44:10,995 adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml' 2025-11-27T00:44:10,996 adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml' 2025-11-27T00:44:10,997 adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml' 2025-11-27T00:44:10,999 adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml' 2025-11-27T00:44:11,000 adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml' 2025-11-27T00:44:11,001 adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml' 2025-11-27T00:44:11,002 adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml' 2025-11-27T00:44:11,003 adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml' 2025-11-27T00:44:11,004 adding 'lm_eval/tasks/catalan_bench/catcola.yaml' 2025-11-27T00:44:11,005 adding 'lm_eval/tasks/catalan_bench/cocoteros_va.yaml' 2025-11-27T00:44:11,007 adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml' 2025-11-27T00:44:11,008 adding 'lm_eval/tasks/catalan_bench/coqcat.yaml' 2025-11-27T00:44:11,009 adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml' 2025-11-27T00:44:11,010 adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml' 2025-11-27T00:44:11,012 adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml' 2025-11-27T00:44:11,013 adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml' 2025-11-27T00:44:11,014 adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml' 2025-11-27T00:44:11,015 adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml' 2025-11-27T00:44:11,016 adding 'lm_eval/tasks/catalan_bench/teca.yaml' 2025-11-27T00:44:11,017 adding 'lm_eval/tasks/catalan_bench/utils.py' 2025-11-27T00:44:11,019 adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml' 2025-11-27T00:44:11,020 adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml' 2025-11-27T00:44:11,021 adding 'lm_eval/tasks/catalan_bench/xnli_va.yaml' 2025-11-27T00:44:11,022 adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml' 2025-11-27T00:44:11,023 adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml' 2025-11-27T00:44:11,025 adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml' 2025-11-27T00:44:11,027 adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py' 2025-11-27T00:44:11,028 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml' 2025-11-27T00:44:11,029 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml' 2025-11-27T00:44:11,030 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml' 2025-11-27T00:44:11,032 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml' 2025-11-27T00:44:11,033 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml' 2025-11-27T00:44:11,034 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml' 2025-11-27T00:44:11,035 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml' 2025-11-27T00:44:11,036 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml' 2025-11-27T00:44:11,037 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml' 2025-11-27T00:44:11,039 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml' 2025-11-27T00:44:11,040 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml' 2025-11-27T00:44:11,041 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml' 2025-11-27T00:44:11,042 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml' 2025-11-27T00:44:11,043 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml' 2025-11-27T00:44:11,044 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml' 2025-11-27T00:44:11,046 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml' 2025-11-27T00:44:11,047 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml' 2025-11-27T00:44:11,049 adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common' 2025-11-27T00:44:11,050 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml' 2025-11-27T00:44:11,051 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml' 2025-11-27T00:44:11,054 adding 'lm_eval/tasks/ceval/README.md' 2025-11-27T00:44:11,055 adding 'lm_eval/tasks/ceval/_ceval-valid.yaml' 2025-11-27T00:44:11,056 adding 'lm_eval/tasks/ceval/_default_ceval_yaml' 2025-11-27T00:44:11,058 adding 'lm_eval/tasks/ceval/_generate_configs.py' 2025-11-27T00:44:11,059 adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml' 2025-11-27T00:44:11,060 adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml' 2025-11-27T00:44:11,061 adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml' 2025-11-27T00:44:11,063 adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml' 2025-11-27T00:44:11,064 adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml' 2025-11-27T00:44:11,065 adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml' 2025-11-27T00:44:11,066 adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml' 2025-11-27T00:44:11,067 adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml' 2025-11-27T00:44:11,068 adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml' 2025-11-27T00:44:11,070 adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml' 2025-11-27T00:44:11,071 adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml' 2025-11-27T00:44:11,072 adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml' 2025-11-27T00:44:11,073 adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml' 2025-11-27T00:44:11,074 adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml' 2025-11-27T00:44:11,075 adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml' 2025-11-27T00:44:11,077 adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml' 2025-11-27T00:44:11,078 adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml' 2025-11-27T00:44:11,079 adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml' 2025-11-27T00:44:11,080 adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml' 2025-11-27T00:44:11,081 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml' 2025-11-27T00:44:11,082 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml' 2025-11-27T00:44:11,084 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml' 2025-11-27T00:44:11,085 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml' 2025-11-27T00:44:11,086 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml' 2025-11-27T00:44:11,087 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml' 2025-11-27T00:44:11,088 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml' 2025-11-27T00:44:11,089 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml' 2025-11-27T00:44:11,091 adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml' 2025-11-27T00:44:11,092 adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml' 2025-11-27T00:44:11,093 adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml' 2025-11-27T00:44:11,094 adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml' 2025-11-27T00:44:11,095 adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml' 2025-11-27T00:44:11,097 adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml' 2025-11-27T00:44:11,098 adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml' 2025-11-27T00:44:11,099 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml' 2025-11-27T00:44:11,100 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml' 2025-11-27T00:44:11,101 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml' 2025-11-27T00:44:11,103 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml' 2025-11-27T00:44:11,104 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml' 2025-11-27T00:44:11,105 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml' 2025-11-27T00:44:11,106 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml' 2025-11-27T00:44:11,107 adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml' 2025-11-27T00:44:11,108 adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml' 2025-11-27T00:44:11,110 adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml' 2025-11-27T00:44:11,111 adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml' 2025-11-27T00:44:11,112 adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml' 2025-11-27T00:44:11,113 adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml' 2025-11-27T00:44:11,114 adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml' 2025-11-27T00:44:11,115 adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml' 2025-11-27T00:44:11,116 adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml' 2025-11-27T00:44:11,117 adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml' 2025-11-27T00:44:11,119 adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml' 2025-11-27T00:44:11,120 adding 'lm_eval/tasks/chartqa/README.md' 2025-11-27T00:44:11,122 adding 'lm_eval/tasks/chartqa/chartqa.yaml' 2025-11-27T00:44:11,123 adding 'lm_eval/tasks/chartqa/chartqa_llama.yaml' 2025-11-27T00:44:11,124 adding 'lm_eval/tasks/chartqa/chartqa_llama_90.yaml' 2025-11-27T00:44:11,126 adding 'lm_eval/tasks/chartqa/utils.py' 2025-11-27T00:44:11,128 adding 'lm_eval/tasks/click/README.md' 2025-11-27T00:44:11,129 adding 'lm_eval/tasks/click/click.yaml' 2025-11-27T00:44:11,131 adding 'lm_eval/tasks/click/click_cul/_click_cul.yaml' 2025-11-27T00:44:11,132 adding 'lm_eval/tasks/click/click_cul/_default_click_cul_yaml' 2025-11-27T00:44:11,133 adding 'lm_eval/tasks/click/click_cul/click_cul_economy.yaml' 2025-11-27T00:44:11,134 adding 'lm_eval/tasks/click/click_cul/click_cul_geography.yaml' 2025-11-27T00:44:11,135 adding 'lm_eval/tasks/click/click_cul/click_cul_history.yaml' 2025-11-27T00:44:11,137 adding 'lm_eval/tasks/click/click_cul/click_cul_kpop.yaml' 2025-11-27T00:44:11,138 adding 'lm_eval/tasks/click/click_cul/click_cul_law.yaml' 2025-11-27T00:44:11,139 adding 'lm_eval/tasks/click/click_cul/click_cul_politics.yaml' 2025-11-27T00:44:11,140 adding 'lm_eval/tasks/click/click_cul/click_cul_society.yaml' 2025-11-27T00:44:11,141 adding 'lm_eval/tasks/click/click_cul/click_cul_tradition.yaml' 2025-11-27T00:44:11,142 adding 'lm_eval/tasks/click/click_cul/utils.py' 2025-11-27T00:44:11,144 adding 'lm_eval/tasks/click/click_lang/_click_lang.yaml' 2025-11-27T00:44:11,145 adding 'lm_eval/tasks/click/click_lang/_default_click_lang_yaml' 2025-11-27T00:44:11,147 adding 'lm_eval/tasks/click/click_lang/click_lang_function.yaml' 2025-11-27T00:44:11,148 adding 'lm_eval/tasks/click/click_lang/click_lang_grammar.yaml' 2025-11-27T00:44:11,149 adding 'lm_eval/tasks/click/click_lang/click_lang_text.yaml' 2025-11-27T00:44:11,150 adding 'lm_eval/tasks/click/click_lang/utils.py' 2025-11-27T00:44:11,153 adding 'lm_eval/tasks/cmmlu/README.md' 2025-11-27T00:44:11,155 adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml' 2025-11-27T00:44:11,156 adding 'lm_eval/tasks/cmmlu/_default_template_yaml' 2025-11-27T00:44:11,157 adding 'lm_eval/tasks/cmmlu/_generate_configs.py' 2025-11-27T00:44:11,159 adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml' 2025-11-27T00:44:11,160 adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml' 2025-11-27T00:44:11,162 adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml' 2025-11-27T00:44:11,163 adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml' 2025-11-27T00:44:11,164 adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml' 2025-11-27T00:44:11,166 adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml' 2025-11-27T00:44:11,168 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml' 2025-11-27T00:44:11,169 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml' 2025-11-27T00:44:11,170 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml' 2025-11-27T00:44:11,171 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml' 2025-11-27T00:44:11,173 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml' 2025-11-27T00:44:11,174 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml' 2025-11-27T00:44:11,175 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml' 2025-11-27T00:44:11,176 adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml' 2025-11-27T00:44:11,177 adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml' 2025-11-27T00:44:11,178 adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml' 2025-11-27T00:44:11,179 adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml' 2025-11-27T00:44:11,181 adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml' 2025-11-27T00:44:11,182 adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml' 2025-11-27T00:44:11,183 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml' 2025-11-27T00:44:11,184 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml' 2025-11-27T00:44:11,185 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml' 2025-11-27T00:44:11,186 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml' 2025-11-27T00:44:11,188 adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml' 2025-11-27T00:44:11,189 adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml' 2025-11-27T00:44:11,190 adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml' 2025-11-27T00:44:11,191 adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml' 2025-11-27T00:44:11,192 adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml' 2025-11-27T00:44:11,193 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml' 2025-11-27T00:44:11,194 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml' 2025-11-27T00:44:11,195 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml' 2025-11-27T00:44:11,196 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml' 2025-11-27T00:44:11,198 adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml' 2025-11-27T00:44:11,199 adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml' 2025-11-27T00:44:11,200 adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml' 2025-11-27T00:44:11,202 adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml' 2025-11-27T00:44:11,203 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml' 2025-11-27T00:44:11,204 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml' 2025-11-27T00:44:11,206 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml' 2025-11-27T00:44:11,207 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml' 2025-11-27T00:44:11,209 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml' 2025-11-27T00:44:11,210 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml' 2025-11-27T00:44:11,212 adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml' 2025-11-27T00:44:11,213 adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml' 2025-11-27T00:44:11,214 adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml' 2025-11-27T00:44:11,215 adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml' 2025-11-27T00:44:11,217 adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml' 2025-11-27T00:44:11,218 adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml' 2025-11-27T00:44:11,219 adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml' 2025-11-27T00:44:11,220 adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml' 2025-11-27T00:44:11,221 adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml' 2025-11-27T00:44:11,223 adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml' 2025-11-27T00:44:11,224 adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml' 2025-11-27T00:44:11,225 adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml' 2025-11-27T00:44:11,226 adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml' 2025-11-27T00:44:11,228 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml' 2025-11-27T00:44:11,229 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml' 2025-11-27T00:44:11,230 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml' 2025-11-27T00:44:11,231 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml' 2025-11-27T00:44:11,233 adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml' 2025-11-27T00:44:11,234 adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml' 2025-11-27T00:44:11,235 adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml' 2025-11-27T00:44:11,236 adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml' 2025-11-27T00:44:11,237 adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml' 2025-11-27T00:44:11,238 adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml' 2025-11-27T00:44:11,239 adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml' 2025-11-27T00:44:11,240 adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml' 2025-11-27T00:44:11,243 adding 'lm_eval/tasks/cnn_dailymail/README.md' 2025-11-27T00:44:11,244 adding 'lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml' 2025-11-27T00:44:11,246 adding 'lm_eval/tasks/cnn_dailymail/utils.py' 2025-11-27T00:44:11,249 adding 'lm_eval/tasks/code_x_glue/code-text/README.md' 2025-11-27T00:44:11,250 adding 'lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml' 2025-11-27T00:44:11,252 adding 'lm_eval/tasks/code_x_glue/code-text/_default_template_yaml' 2025-11-27T00:44:11,254 adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py' 2025-11-27T00:44:11,255 adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml' 2025-11-27T00:44:11,257 adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml' 2025-11-27T00:44:11,258 adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml' 2025-11-27T00:44:11,259 adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml' 2025-11-27T00:44:11,260 adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml' 2025-11-27T00:44:11,261 adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml' 2025-11-27T00:44:11,263 adding 'lm_eval/tasks/code_x_glue/code-text/utils.py' 2025-11-27T00:44:11,264 adding 'lm_eval/tasks/common_voice/common_voice_en.yaml' 2025-11-27T00:44:11,266 adding 'lm_eval/tasks/common_voice/utils.py' 2025-11-27T00:44:11,268 adding 'lm_eval/tasks/commonsense_qa/README.md' 2025-11-27T00:44:11,269 adding 'lm_eval/tasks/commonsense_qa/default.yaml' 2025-11-27T00:44:11,271 adding 'lm_eval/tasks/copal_id/README.md' 2025-11-27T00:44:11,272 adding 'lm_eval/tasks/copal_id/colloquial.yaml' 2025-11-27T00:44:11,273 adding 'lm_eval/tasks/copal_id/standard.yaml' 2025-11-27T00:44:11,274 adding 'lm_eval/tasks/copal_id/utils.py' 2025-11-27T00:44:11,276 adding 'lm_eval/tasks/coqa/README.md' 2025-11-27T00:44:11,277 adding 'lm_eval/tasks/coqa/default.yaml' 2025-11-27T00:44:11,279 adding 'lm_eval/tasks/coqa/utils.py' 2025-11-27T00:44:11,281 adding 'lm_eval/tasks/crows_pairs/README.md' 2025-11-27T00:44:11,283 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml' 2025-11-27T00:44:11,284 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml' 2025-11-27T00:44:11,285 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml' 2025-11-27T00:44:11,286 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml' 2025-11-27T00:44:11,287 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml' 2025-11-27T00:44:11,288 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml' 2025-11-27T00:44:11,290 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml' 2025-11-27T00:44:11,291 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml' 2025-11-27T00:44:11,292 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml' 2025-11-27T00:44:11,293 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml' 2025-11-27T00:44:11,294 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml' 2025-11-27T00:44:11,295 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml' 2025-11-27T00:44:11,297 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml' 2025-11-27T00:44:11,298 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml' 2025-11-27T00:44:11,299 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml' 2025-11-27T00:44:11,300 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml' 2025-11-27T00:44:11,301 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml' 2025-11-27T00:44:11,303 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml' 2025-11-27T00:44:11,304 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml' 2025-11-27T00:44:11,305 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml' 2025-11-27T00:44:11,306 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml' 2025-11-27T00:44:11,307 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml' 2025-11-27T00:44:11,308 adding 'lm_eval/tasks/crows_pairs/utils.py' 2025-11-27T00:44:11,310 adding 'lm_eval/tasks/csatqa/_csatqa.yaml' 2025-11-27T00:44:11,311 adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml' 2025-11-27T00:44:11,312 adding 'lm_eval/tasks/csatqa/_generate_configs.py' 2025-11-27T00:44:11,314 adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml' 2025-11-27T00:44:11,315 adding 'lm_eval/tasks/csatqa/csatqa_li.yaml' 2025-11-27T00:44:11,316 adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml' 2025-11-27T00:44:11,317 adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml' 2025-11-27T00:44:11,319 adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml' 2025-11-27T00:44:11,320 adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml' 2025-11-27T00:44:11,321 adding 'lm_eval/tasks/csatqa/utils.py' 2025-11-27T00:44:11,323 adding 'lm_eval/tasks/darija_bench/README.md' 2025-11-27T00:44:11,325 adding 'lm_eval/tasks/darija_bench/darija_sentiment/README.md' 2025-11-27T00:44:11,326 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml' 2025-11-27T00:44:11,327 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml' 2025-11-27T00:44:11,328 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml' 2025-11-27T00:44:11,329 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml' 2025-11-27T00:44:11,330 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml' 2025-11-27T00:44:11,332 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml' 2025-11-27T00:44:11,333 adding 'lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml' 2025-11-27T00:44:11,334 adding 'lm_eval/tasks/darija_bench/darija_sentiment/utils.py' 2025-11-27T00:44:11,336 adding 'lm_eval/tasks/darija_bench/darija_summarization/README.md' 2025-11-27T00:44:11,337 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml' 2025-11-27T00:44:11,339 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml' 2025-11-27T00:44:11,340 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml' 2025-11-27T00:44:11,341 adding 'lm_eval/tasks/darija_bench/darija_summarization/utils.py' 2025-11-27T00:44:11,344 adding 'lm_eval/tasks/darija_bench/darija_translation/README.md' 2025-11-27T00:44:11,345 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml' 2025-11-27T00:44:11,346 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml' 2025-11-27T00:44:11,347 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml' 2025-11-27T00:44:11,348 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml' 2025-11-27T00:44:11,350 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml' 2025-11-27T00:44:11,351 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml' 2025-11-27T00:44:11,352 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml' 2025-11-27T00:44:11,353 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml' 2025-11-27T00:44:11,354 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml' 2025-11-27T00:44:11,355 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml' 2025-11-27T00:44:11,357 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml' 2025-11-27T00:44:11,358 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml' 2025-11-27T00:44:11,359 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml' 2025-11-27T00:44:11,360 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml' 2025-11-27T00:44:11,361 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml' 2025-11-27T00:44:11,362 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml' 2025-11-27T00:44:11,363 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml' 2025-11-27T00:44:11,365 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml' 2025-11-27T00:44:11,366 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml' 2025-11-27T00:44:11,367 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml' 2025-11-27T00:44:11,368 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml' 2025-11-27T00:44:11,369 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml' 2025-11-27T00:44:11,370 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml' 2025-11-27T00:44:11,371 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml' 2025-11-27T00:44:11,373 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml' 2025-11-27T00:44:11,374 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml' 2025-11-27T00:44:11,375 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml' 2025-11-27T00:44:11,376 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml' 2025-11-27T00:44:11,377 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml' 2025-11-27T00:44:11,378 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml' 2025-11-27T00:44:11,380 adding 'lm_eval/tasks/darija_bench/darija_translation/utils.py' 2025-11-27T00:44:11,382 adding 'lm_eval/tasks/darija_bench/darija_transliteration/README.md' 2025-11-27T00:44:11,383 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml' 2025-11-27T00:44:11,384 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml' 2025-11-27T00:44:11,385 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml' 2025-11-27T00:44:11,387 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml' 2025-11-27T00:44:11,388 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml' 2025-11-27T00:44:11,389 adding 'lm_eval/tasks/darija_bench/darija_transliteration/utils.py' 2025-11-27T00:44:11,391 adding 'lm_eval/tasks/darijahellaswag/README.md' 2025-11-27T00:44:11,392 adding 'lm_eval/tasks/darijahellaswag/darijahellaswag.yaml' 2025-11-27T00:44:11,393 adding 'lm_eval/tasks/darijahellaswag/utils.py' 2025-11-27T00:44:11,396 adding 'lm_eval/tasks/darijammlu/README.md' 2025-11-27T00:44:11,398 adding 'lm_eval/tasks/darijammlu/_darijammlu.yaml' 2025-11-27T00:44:11,399 adding 'lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml' 2025-11-27T00:44:11,400 adding 'lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml' 2025-11-27T00:44:11,401 adding 'lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml' 2025-11-27T00:44:11,403 adding 'lm_eval/tasks/darijammlu/_generate_configs.py' 2025-11-27T00:44:11,404 adding 'lm_eval/tasks/darijammlu/darijammlu_accounting.yaml' 2025-11-27T00:44:11,405 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml' 2025-11-27T00:44:11,406 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml' 2025-11-27T00:44:11,408 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml' 2025-11-27T00:44:11,409 adding 'lm_eval/tasks/darijammlu/darijammlu_biology.yaml' 2025-11-27T00:44:11,410 adding 'lm_eval/tasks/darijammlu/darijammlu_civics.yaml' 2025-11-27T00:44:11,411 adding 'lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml' 2025-11-27T00:44:11,412 adding 'lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml' 2025-11-27T00:44:11,413 adding 'lm_eval/tasks/darijammlu/darijammlu_economics.yaml' 2025-11-27T00:44:11,414 adding 'lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml' 2025-11-27T00:44:11,415 adding 'lm_eval/tasks/darijammlu/darijammlu_geography.yaml' 2025-11-27T00:44:11,416 adding 'lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml' 2025-11-27T00:44:11,417 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml' 2025-11-27T00:44:11,418 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml' 2025-11-27T00:44:11,420 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:11,421 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml' 2025-11-27T00:44:11,422 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml' 2025-11-27T00:44:11,423 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml' 2025-11-27T00:44:11,425 adding 'lm_eval/tasks/darijammlu/darijammlu_history.yaml' 2025-11-27T00:44:11,426 adding 'lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml' 2025-11-27T00:44:11,427 adding 'lm_eval/tasks/darijammlu/darijammlu_international_law.yaml' 2025-11-27T00:44:11,428 adding 'lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml' 2025-11-27T00:44:11,429 adding 'lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml' 2025-11-27T00:44:11,430 adding 'lm_eval/tasks/darijammlu/darijammlu_law.yaml' 2025-11-27T00:44:11,431 adding 'lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml' 2025-11-27T00:44:11,432 adding 'lm_eval/tasks/darijammlu/darijammlu_management.yaml' 2025-11-27T00:44:11,433 adding 'lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml' 2025-11-27T00:44:11,435 adding 'lm_eval/tasks/darijammlu/darijammlu_marketing.yaml' 2025-11-27T00:44:11,436 adding 'lm_eval/tasks/darijammlu/darijammlu_math.yaml' 2025-11-27T00:44:11,437 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml' 2025-11-27T00:44:11,438 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml' 2025-11-27T00:44:11,439 adding 'lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml' 2025-11-27T00:44:11,440 adding 'lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml' 2025-11-27T00:44:11,441 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml' 2025-11-27T00:44:11,443 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml' 2025-11-27T00:44:11,444 adding 'lm_eval/tasks/darijammlu/darijammlu_physics.yaml' 2025-11-27T00:44:11,445 adding 'lm_eval/tasks/darijammlu/darijammlu_political_science.yaml' 2025-11-27T00:44:11,446 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml' 2025-11-27T00:44:11,447 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml' 2025-11-27T00:44:11,449 adding 'lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml' 2025-11-27T00:44:11,450 adding 'lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml' 2025-11-27T00:44:11,451 adding 'lm_eval/tasks/darijammlu/darijammlu_social_science.yaml' 2025-11-27T00:44:11,452 adding 'lm_eval/tasks/darijammlu/darijammlu_sociology.yaml' 2025-11-27T00:44:11,453 adding 'lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml' 2025-11-27T00:44:11,454 adding 'lm_eval/tasks/darijammlu/utils.py' 2025-11-27T00:44:11,456 adding 'lm_eval/tasks/discrim_eval/README.md' 2025-11-27T00:44:11,458 adding 'lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml' 2025-11-27T00:44:11,459 adding 'lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml' 2025-11-27T00:44:11,460 adding 'lm_eval/tasks/discrim_eval/utils.py' 2025-11-27T00:44:11,462 adding 'lm_eval/tasks/drop/README.md' 2025-11-27T00:44:11,463 adding 'lm_eval/tasks/drop/default.yaml' 2025-11-27T00:44:11,465 adding 'lm_eval/tasks/drop/utils.py' 2025-11-27T00:44:11,467 adding 'lm_eval/tasks/egyhellaswag/README.md' 2025-11-27T00:44:11,468 adding 'lm_eval/tasks/egyhellaswag/egyhellaswag.yaml' 2025-11-27T00:44:11,469 adding 'lm_eval/tasks/egyhellaswag/utils.py' 2025-11-27T00:44:11,472 adding 'lm_eval/tasks/egymmlu/README.md' 2025-11-27T00:44:11,473 adding 'lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml' 2025-11-27T00:44:11,474 adding 'lm_eval/tasks/egymmlu/_egymmlu.yaml' 2025-11-27T00:44:11,475 adding 'lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml' 2025-11-27T00:44:11,476 adding 'lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml' 2025-11-27T00:44:11,477 adding 'lm_eval/tasks/egymmlu/_generate_configs.py' 2025-11-27T00:44:11,479 adding 'lm_eval/tasks/egymmlu/egymmlu_accounting.yaml' 2025-11-27T00:44:11,480 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml' 2025-11-27T00:44:11,481 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml' 2025-11-27T00:44:11,482 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml' 2025-11-27T00:44:11,483 adding 'lm_eval/tasks/egymmlu/egymmlu_biology.yaml' 2025-11-27T00:44:11,484 adding 'lm_eval/tasks/egymmlu/egymmlu_civics.yaml' 2025-11-27T00:44:11,485 adding 'lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml' 2025-11-27T00:44:11,487 adding 'lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml' 2025-11-27T00:44:11,488 adding 'lm_eval/tasks/egymmlu/egymmlu_economics.yaml' 2025-11-27T00:44:11,489 adding 'lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml' 2025-11-27T00:44:11,490 adding 'lm_eval/tasks/egymmlu/egymmlu_geography.yaml' 2025-11-27T00:44:11,491 adding 'lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml' 2025-11-27T00:44:11,492 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml' 2025-11-27T00:44:11,493 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml' 2025-11-27T00:44:11,495 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:11,496 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml' 2025-11-27T00:44:11,497 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml' 2025-11-27T00:44:11,498 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml' 2025-11-27T00:44:11,499 adding 'lm_eval/tasks/egymmlu/egymmlu_history.yaml' 2025-11-27T00:44:11,500 adding 'lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml' 2025-11-27T00:44:11,502 adding 'lm_eval/tasks/egymmlu/egymmlu_international_law.yaml' 2025-11-27T00:44:11,503 adding 'lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml' 2025-11-27T00:44:11,504 adding 'lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml' 2025-11-27T00:44:11,505 adding 'lm_eval/tasks/egymmlu/egymmlu_law.yaml' 2025-11-27T00:44:11,506 adding 'lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml' 2025-11-27T00:44:11,508 adding 'lm_eval/tasks/egymmlu/egymmlu_management.yaml' 2025-11-27T00:44:11,509 adding 'lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml' 2025-11-27T00:44:11,510 adding 'lm_eval/tasks/egymmlu/egymmlu_marketing.yaml' 2025-11-27T00:44:11,511 adding 'lm_eval/tasks/egymmlu/egymmlu_math.yaml' 2025-11-27T00:44:11,512 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml' 2025-11-27T00:44:11,513 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml' 2025-11-27T00:44:11,517 adding 'lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml' 2025-11-27T00:44:11,518 adding 'lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml' 2025-11-27T00:44:11,519 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml' 2025-11-27T00:44:11,520 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml' 2025-11-27T00:44:11,521 adding 'lm_eval/tasks/egymmlu/egymmlu_physics.yaml' 2025-11-27T00:44:11,523 adding 'lm_eval/tasks/egymmlu/egymmlu_political_science.yaml' 2025-11-27T00:44:11,524 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml' 2025-11-27T00:44:11,525 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml' 2025-11-27T00:44:11,526 adding 'lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml' 2025-11-27T00:44:11,527 adding 'lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml' 2025-11-27T00:44:11,528 adding 'lm_eval/tasks/egymmlu/egymmlu_social_science.yaml' 2025-11-27T00:44:11,529 adding 'lm_eval/tasks/egymmlu/egymmlu_sociology.yaml' 2025-11-27T00:44:11,530 adding 'lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml' 2025-11-27T00:44:11,532 adding 'lm_eval/tasks/egymmlu/utils.py' 2025-11-27T00:44:11,534 adding 'lm_eval/tasks/eq_bench/README.md' 2025-11-27T00:44:11,535 adding 'lm_eval/tasks/eq_bench/default.yaml' 2025-11-27T00:44:11,536 adding 'lm_eval/tasks/eq_bench/utils.py' 2025-11-27T00:44:11,538 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml' 2025-11-27T00:44:11,539 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml' 2025-11-27T00:44:11,540 adding 'lm_eval/tasks/eq_bench/multilingual/utils.py' 2025-11-27T00:44:11,542 adding 'lm_eval/tasks/esbbq/README.md' 2025-11-27T00:44:11,543 adding 'lm_eval/tasks/esbbq/_esbbq_common_yaml' 2025-11-27T00:44:11,545 adding 'lm_eval/tasks/esbbq/esbbq.yaml' 2025-11-27T00:44:11,546 adding 'lm_eval/tasks/esbbq/esbbq_age.yaml' 2025-11-27T00:44:11,547 adding 'lm_eval/tasks/esbbq/esbbq_disability_status.yaml' 2025-11-27T00:44:11,548 adding 'lm_eval/tasks/esbbq/esbbq_gender.yaml' 2025-11-27T00:44:11,549 adding 'lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml' 2025-11-27T00:44:11,550 adding 'lm_eval/tasks/esbbq/esbbq_nationality.yaml' 2025-11-27T00:44:11,551 adding 'lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml' 2025-11-27T00:44:11,552 adding 'lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml' 2025-11-27T00:44:11,553 adding 'lm_eval/tasks/esbbq/esbbq_religion.yaml' 2025-11-27T00:44:11,555 adding 'lm_eval/tasks/esbbq/esbbq_ses.yaml' 2025-11-27T00:44:11,556 adding 'lm_eval/tasks/esbbq/esbbq_spanish_region.yaml' 2025-11-27T00:44:11,557 adding 'lm_eval/tasks/esbbq/utils.py' 2025-11-27T00:44:11,561 adding 'lm_eval/tasks/eus_exams/README.md' 2025-11-27T00:44:11,562 adding 'lm_eval/tasks/eus_exams/configs.py' 2025-11-27T00:44:11,564 adding 'lm_eval/tasks/eus_exams/eus_exams' 2025-11-27T00:44:11,565 adding 'lm_eval/tasks/eus_exams/eus_exams_es' 2025-11-27T00:44:11,566 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml' 2025-11-27T00:44:11,567 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml' 2025-11-27T00:44:11,568 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml' 2025-11-27T00:44:11,569 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml' 2025-11-27T00:44:11,571 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml' 2025-11-27T00:44:11,572 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml' 2025-11-27T00:44:11,573 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml' 2025-11-27T00:44:11,574 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml' 2025-11-27T00:44:11,575 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml' 2025-11-27T00:44:11,576 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml' 2025-11-27T00:44:11,577 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml' 2025-11-27T00:44:11,579 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml' 2025-11-27T00:44:11,580 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml' 2025-11-27T00:44:11,581 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml' 2025-11-27T00:44:11,582 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml' 2025-11-27T00:44:11,583 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml' 2025-11-27T00:44:11,585 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml' 2025-11-27T00:44:11,586 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml' 2025-11-27T00:44:11,587 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml' 2025-11-27T00:44:11,589 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml' 2025-11-27T00:44:11,590 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml' 2025-11-27T00:44:11,591 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml' 2025-11-27T00:44:11,592 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml' 2025-11-27T00:44:11,593 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml' 2025-11-27T00:44:11,594 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml' 2025-11-27T00:44:11,595 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml' 2025-11-27T00:44:11,596 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml' 2025-11-27T00:44:11,597 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml' 2025-11-27T00:44:11,598 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml' 2025-11-27T00:44:11,600 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml' 2025-11-27T00:44:11,601 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml' 2025-11-27T00:44:11,602 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml' 2025-11-27T00:44:11,603 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml' 2025-11-27T00:44:11,604 adding 'lm_eval/tasks/eus_exams/eus_exams_eu' 2025-11-27T00:44:11,605 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml' 2025-11-27T00:44:11,606 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml' 2025-11-27T00:44:11,608 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml' 2025-11-27T00:44:11,609 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml' 2025-11-27T00:44:11,610 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml' 2025-11-27T00:44:11,611 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml' 2025-11-27T00:44:11,612 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml' 2025-11-27T00:44:11,613 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml' 2025-11-27T00:44:11,614 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml' 2025-11-27T00:44:11,616 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml' 2025-11-27T00:44:11,617 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml' 2025-11-27T00:44:11,618 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml' 2025-11-27T00:44:11,619 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml' 2025-11-27T00:44:11,620 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml' 2025-11-27T00:44:11,621 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml' 2025-11-27T00:44:11,622 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml' 2025-11-27T00:44:11,624 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml' 2025-11-27T00:44:11,625 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml' 2025-11-27T00:44:11,626 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml' 2025-11-27T00:44:11,627 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml' 2025-11-27T00:44:11,628 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml' 2025-11-27T00:44:11,629 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml' 2025-11-27T00:44:11,631 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml' 2025-11-27T00:44:11,632 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml' 2025-11-27T00:44:11,633 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml' 2025-11-27T00:44:11,634 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml' 2025-11-27T00:44:11,635 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml' 2025-11-27T00:44:11,636 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml' 2025-11-27T00:44:11,638 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml' 2025-11-27T00:44:11,639 adding 'lm_eval/tasks/eus_exams/utils.py' 2025-11-27T00:44:11,641 adding 'lm_eval/tasks/eus_proficiency/README.md' 2025-11-27T00:44:11,642 adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml' 2025-11-27T00:44:11,644 adding 'lm_eval/tasks/eus_reading/README.md' 2025-11-27T00:44:11,645 adding 'lm_eval/tasks/eus_reading/eus_reading.yaml' 2025-11-27T00:44:11,646 adding 'lm_eval/tasks/eus_reading/utils.py' 2025-11-27T00:44:11,648 adding 'lm_eval/tasks/eus_trivia/README.md' 2025-11-27T00:44:11,649 adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml' 2025-11-27T00:44:11,650 adding 'lm_eval/tasks/eus_trivia/utils.py' 2025-11-27T00:44:11,654 adding 'lm_eval/tasks/evalita_llm/README.md' 2025-11-27T00:44:11,655 adding 'lm_eval/tasks/evalita_llm/_at_template_yaml' 2025-11-27T00:44:11,657 adding 'lm_eval/tasks/evalita_llm/_evalita-mp.yaml' 2025-11-27T00:44:11,658 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml' 2025-11-27T00:44:11,659 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml' 2025-11-27T00:44:11,660 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml' 2025-11-27T00:44:11,662 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml' 2025-11-27T00:44:11,663 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml' 2025-11-27T00:44:11,664 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml' 2025-11-27T00:44:11,665 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml' 2025-11-27T00:44:11,667 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml' 2025-11-27T00:44:11,668 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml' 2025-11-27T00:44:11,669 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml' 2025-11-27T00:44:11,670 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml' 2025-11-27T00:44:11,671 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml' 2025-11-27T00:44:11,672 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml' 2025-11-27T00:44:11,674 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml' 2025-11-27T00:44:11,675 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml' 2025-11-27T00:44:11,676 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml' 2025-11-27T00:44:11,677 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml' 2025-11-27T00:44:11,678 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml' 2025-11-27T00:44:11,680 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml' 2025-11-27T00:44:11,681 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml' 2025-11-27T00:44:11,682 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml' 2025-11-27T00:44:11,683 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml' 2025-11-27T00:44:11,684 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml' 2025-11-27T00:44:11,686 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml' 2025-11-27T00:44:11,687 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml' 2025-11-27T00:44:11,688 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml' 2025-11-27T00:44:11,689 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml' 2025-11-27T00:44:11,691 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml' 2025-11-27T00:44:11,692 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml' 2025-11-27T00:44:11,693 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml' 2025-11-27T00:44:11,694 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml' 2025-11-27T00:44:11,696 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml' 2025-11-27T00:44:11,697 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml' 2025-11-27T00:44:11,698 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml' 2025-11-27T00:44:11,699 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml' 2025-11-27T00:44:11,701 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg' 2025-11-27T00:44:11,702 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml' 2025-11-27T00:44:11,703 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml' 2025-11-27T00:44:11,704 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic' 2025-11-27T00:44:11,705 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml' 2025-11-27T00:44:11,706 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml' 2025-11-27T00:44:11,708 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml' 2025-11-27T00:44:11,709 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn' 2025-11-27T00:44:11,710 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml' 2025-11-27T00:44:11,711 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml' 2025-11-27T00:44:11,712 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml' 2025-11-27T00:44:11,713 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml' 2025-11-27T00:44:11,714 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml' 2025-11-27T00:44:11,716 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml' 2025-11-27T00:44:11,717 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml' 2025-11-27T00:44:11,718 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml' 2025-11-27T00:44:11,720 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml' 2025-11-27T00:44:11,721 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml' 2025-11-27T00:44:11,722 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml' 2025-11-27T00:44:11,723 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml' 2025-11-27T00:44:11,724 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml' 2025-11-27T00:44:11,725 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml' 2025-11-27T00:44:11,727 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml' 2025-11-27T00:44:11,728 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml' 2025-11-27T00:44:11,729 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml' 2025-11-27T00:44:11,730 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml' 2025-11-27T00:44:11,731 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml' 2025-11-27T00:44:11,733 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml' 2025-11-27T00:44:11,734 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml' 2025-11-27T00:44:11,735 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml' 2025-11-27T00:44:11,736 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml' 2025-11-27T00:44:11,737 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml' 2025-11-27T00:44:11,739 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml' 2025-11-27T00:44:11,740 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml' 2025-11-27T00:44:11,741 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml' 2025-11-27T00:44:11,742 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml' 2025-11-27T00:44:11,743 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml' 2025-11-27T00:44:11,744 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml' 2025-11-27T00:44:11,746 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml' 2025-11-27T00:44:11,747 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml' 2025-11-27T00:44:11,748 adding 'lm_eval/tasks/evalita_llm/_faq_template_yaml' 2025-11-27T00:44:11,749 adding 'lm_eval/tasks/evalita_llm/_hs_template_yaml' 2025-11-27T00:44:11,751 adding 'lm_eval/tasks/evalita_llm/_ls_template_yaml' 2025-11-27T00:44:11,752 adding 'lm_eval/tasks/evalita_llm/_ner_template_yaml' 2025-11-27T00:44:11,753 adding 'lm_eval/tasks/evalita_llm/_re_template_yaml' 2025-11-27T00:44:11,754 adding 'lm_eval/tasks/evalita_llm/_sa_template_v2_yaml' 2025-11-27T00:44:11,755 adding 'lm_eval/tasks/evalita_llm/_sa_template_yaml' 2025-11-27T00:44:11,757 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml' 2025-11-27T00:44:11,758 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp_yaml' 2025-11-27T00:44:11,759 adding 'lm_eval/tasks/evalita_llm/_sum_template_yaml' 2025-11-27T00:44:11,760 adding 'lm_eval/tasks/evalita_llm/_te_template_yaml' 2025-11-27T00:44:11,761 adding 'lm_eval/tasks/evalita_llm/_wic_template_yaml' 2025-11-27T00:44:11,763 adding 'lm_eval/tasks/evalita_llm/metrics.py' 2025-11-27T00:44:11,764 adding 'lm_eval/tasks/evalita_llm/sum_utils.py' 2025-11-27T00:44:11,766 adding 'lm_eval/tasks/evalita_llm/utils.py' 2025-11-27T00:44:11,768 adding 'lm_eval/tasks/fda/README.md' 2025-11-27T00:44:11,769 adding 'lm_eval/tasks/fda/fda.yaml' 2025-11-27T00:44:11,771 adding 'lm_eval/tasks/fda/task.py' 2025-11-27T00:44:11,773 adding 'lm_eval/tasks/fld/README.md' 2025-11-27T00:44:11,774 adding 'lm_eval/tasks/fld/fld_default.yaml' 2025-11-27T00:44:11,775 adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml' 2025-11-27T00:44:11,776 adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml' 2025-11-27T00:44:11,777 adding 'lm_eval/tasks/fld/fld_star.yaml' 2025-11-27T00:44:11,780 adding 'lm_eval/tasks/french_bench/README.md' 2025-11-27T00:44:11,781 adding 'lm_eval/tasks/french_bench/_default_template_yaml' 2025-11-27T00:44:11,782 adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml' 2025-11-27T00:44:11,784 adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml' 2025-11-27T00:44:11,785 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml' 2025-11-27T00:44:11,786 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml' 2025-11-27T00:44:11,787 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml' 2025-11-27T00:44:11,788 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml' 2025-11-27T00:44:11,790 adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml' 2025-11-27T00:44:11,791 adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml' 2025-11-27T00:44:11,792 adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml' 2025-11-27T00:44:11,793 adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml' 2025-11-27T00:44:11,794 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml' 2025-11-27T00:44:11,795 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml' 2025-11-27T00:44:11,797 adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml' 2025-11-27T00:44:11,798 adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml' 2025-11-27T00:44:11,799 adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml' 2025-11-27T00:44:11,800 adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml' 2025-11-27T00:44:11,802 adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml' 2025-11-27T00:44:11,803 adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml' 2025-11-27T00:44:11,804 adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py' 2025-11-27T00:44:11,806 adding 'lm_eval/tasks/french_bench/utils.py' 2025-11-27T00:44:11,808 adding 'lm_eval/tasks/galician_bench/README.md' 2025-11-27T00:44:11,809 adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml' 2025-11-27T00:44:11,810 adding 'lm_eval/tasks/galician_bench/galcola.yaml' 2025-11-27T00:44:11,812 adding 'lm_eval/tasks/galician_bench/galician_bench.yaml' 2025-11-27T00:44:11,813 adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml' 2025-11-27T00:44:11,814 adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml' 2025-11-27T00:44:11,815 adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml' 2025-11-27T00:44:11,817 adding 'lm_eval/tasks/galician_bench/paws_gl.yaml' 2025-11-27T00:44:11,818 adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml' 2025-11-27T00:44:11,819 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml' 2025-11-27T00:44:11,820 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml' 2025-11-27T00:44:11,822 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml' 2025-11-27T00:44:11,823 adding 'lm_eval/tasks/galician_bench/utils.py' 2025-11-27T00:44:11,825 adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml' 2025-11-27T00:44:11,826 adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml' 2025-11-27T00:44:11,828 adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml' 2025-11-27T00:44:11,830 adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py' 2025-11-27T00:44:11,831 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml' 2025-11-27T00:44:11,832 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml' 2025-11-27T00:44:11,833 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml' 2025-11-27T00:44:11,834 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml' 2025-11-27T00:44:11,835 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml' 2025-11-27T00:44:11,836 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml' 2025-11-27T00:44:11,837 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml' 2025-11-27T00:44:11,838 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml' 2025-11-27T00:44:11,840 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml' 2025-11-27T00:44:11,841 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml' 2025-11-27T00:44:11,842 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml' 2025-11-27T00:44:11,843 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml' 2025-11-27T00:44:11,845 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml' 2025-11-27T00:44:11,846 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml' 2025-11-27T00:44:11,847 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml' 2025-11-27T00:44:11,848 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml' 2025-11-27T00:44:11,849 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml' 2025-11-27T00:44:11,851 adding 'lm_eval/tasks/glianorex/README.md' 2025-11-27T00:44:11,853 adding 'lm_eval/tasks/glianorex/glianorex.yaml' 2025-11-27T00:44:11,854 adding 'lm_eval/tasks/glianorex/glianorex_en.yaml' 2025-11-27T00:44:11,855 adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml' 2025-11-27T00:44:11,856 adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py' 2025-11-27T00:44:11,858 adding 'lm_eval/tasks/global_mmlu/README.md' 2025-11-27T00:44:11,861 adding 'lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml' 2025-11-27T00:44:11,862 adding 'lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml' 2025-11-27T00:44:11,863 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml' 2025-11-27T00:44:11,864 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml' 2025-11-27T00:44:11,866 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml' 2025-11-27T00:44:11,867 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml' 2025-11-27T00:44:11,868 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml' 2025-11-27T00:44:11,869 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml' 2025-11-27T00:44:11,870 adding 'lm_eval/tasks/global_mmlu/default/ar/utils.py' 2025-11-27T00:44:11,872 adding 'lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml' 2025-11-27T00:44:11,874 adding 'lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml' 2025-11-27T00:44:11,875 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml' 2025-11-27T00:44:11,876 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml' 2025-11-27T00:44:11,877 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml' 2025-11-27T00:44:11,878 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml' 2025-11-27T00:44:11,880 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml' 2025-11-27T00:44:11,881 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml' 2025-11-27T00:44:11,882 adding 'lm_eval/tasks/global_mmlu/default/bn/utils.py' 2025-11-27T00:44:11,884 adding 'lm_eval/tasks/global_mmlu/default/de/_de_template_yaml' 2025-11-27T00:44:11,885 adding 'lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml' 2025-11-27T00:44:11,886 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml' 2025-11-27T00:44:11,888 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml' 2025-11-27T00:44:11,889 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml' 2025-11-27T00:44:11,890 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml' 2025-11-27T00:44:11,891 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml' 2025-11-27T00:44:11,892 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml' 2025-11-27T00:44:11,893 adding 'lm_eval/tasks/global_mmlu/default/de/utils.py' 2025-11-27T00:44:11,895 adding 'lm_eval/tasks/global_mmlu/default/en/_en_template_yaml' 2025-11-27T00:44:11,896 adding 'lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml' 2025-11-27T00:44:11,897 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml' 2025-11-27T00:44:11,899 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml' 2025-11-27T00:44:11,900 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml' 2025-11-27T00:44:11,901 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml' 2025-11-27T00:44:11,902 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml' 2025-11-27T00:44:11,903 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml' 2025-11-27T00:44:11,904 adding 'lm_eval/tasks/global_mmlu/default/en/utils.py' 2025-11-27T00:44:11,906 adding 'lm_eval/tasks/global_mmlu/default/es/_es_template_yaml' 2025-11-27T00:44:11,907 adding 'lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml' 2025-11-27T00:44:11,909 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml' 2025-11-27T00:44:11,910 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml' 2025-11-27T00:44:11,911 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml' 2025-11-27T00:44:11,912 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml' 2025-11-27T00:44:11,913 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml' 2025-11-27T00:44:11,914 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml' 2025-11-27T00:44:11,915 adding 'lm_eval/tasks/global_mmlu/default/es/utils.py' 2025-11-27T00:44:11,917 adding 'lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml' 2025-11-27T00:44:11,919 adding 'lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml' 2025-11-27T00:44:11,920 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml' 2025-11-27T00:44:11,921 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml' 2025-11-27T00:44:11,922 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml' 2025-11-27T00:44:11,923 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml' 2025-11-27T00:44:11,924 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml' 2025-11-27T00:44:11,926 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml' 2025-11-27T00:44:11,927 adding 'lm_eval/tasks/global_mmlu/default/fr/utils.py' 2025-11-27T00:44:11,929 adding 'lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml' 2025-11-27T00:44:11,930 adding 'lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml' 2025-11-27T00:44:11,931 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml' 2025-11-27T00:44:11,932 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml' 2025-11-27T00:44:11,934 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml' 2025-11-27T00:44:11,935 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml' 2025-11-27T00:44:11,936 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml' 2025-11-27T00:44:11,937 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml' 2025-11-27T00:44:11,938 adding 'lm_eval/tasks/global_mmlu/default/hi/utils.py' 2025-11-27T00:44:11,940 adding 'lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml' 2025-11-27T00:44:11,941 adding 'lm_eval/tasks/global_mmlu/default/id/_id_template_yaml' 2025-11-27T00:44:11,942 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml' 2025-11-27T00:44:11,944 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml' 2025-11-27T00:44:11,945 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml' 2025-11-27T00:44:11,946 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml' 2025-11-27T00:44:11,947 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml' 2025-11-27T00:44:11,948 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml' 2025-11-27T00:44:11,949 adding 'lm_eval/tasks/global_mmlu/default/id/utils.py' 2025-11-27T00:44:11,951 adding 'lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml' 2025-11-27T00:44:11,952 adding 'lm_eval/tasks/global_mmlu/default/it/_it_template_yaml' 2025-11-27T00:44:11,953 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml' 2025-11-27T00:44:11,955 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml' 2025-11-27T00:44:11,956 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml' 2025-11-27T00:44:11,957 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml' 2025-11-27T00:44:11,958 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml' 2025-11-27T00:44:11,959 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml' 2025-11-27T00:44:11,960 adding 'lm_eval/tasks/global_mmlu/default/it/utils.py' 2025-11-27T00:44:11,962 adding 'lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml' 2025-11-27T00:44:11,963 adding 'lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml' 2025-11-27T00:44:11,965 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml' 2025-11-27T00:44:11,966 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml' 2025-11-27T00:44:11,967 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml' 2025-11-27T00:44:11,968 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml' 2025-11-27T00:44:11,969 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml' 2025-11-27T00:44:11,970 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml' 2025-11-27T00:44:11,972 adding 'lm_eval/tasks/global_mmlu/default/ja/utils.py' 2025-11-27T00:44:11,973 adding 'lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml' 2025-11-27T00:44:11,975 adding 'lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml' 2025-11-27T00:44:11,976 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml' 2025-11-27T00:44:11,977 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml' 2025-11-27T00:44:11,978 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml' 2025-11-27T00:44:11,979 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml' 2025-11-27T00:44:11,981 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml' 2025-11-27T00:44:11,982 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml' 2025-11-27T00:44:11,983 adding 'lm_eval/tasks/global_mmlu/default/ko/utils.py' 2025-11-27T00:44:11,985 adding 'lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml' 2025-11-27T00:44:11,986 adding 'lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml' 2025-11-27T00:44:11,987 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml' 2025-11-27T00:44:11,988 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml' 2025-11-27T00:44:11,990 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml' 2025-11-27T00:44:11,991 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml' 2025-11-27T00:44:11,992 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml' 2025-11-27T00:44:11,993 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml' 2025-11-27T00:44:11,994 adding 'lm_eval/tasks/global_mmlu/default/pt/utils.py' 2025-11-27T00:44:11,996 adding 'lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml' 2025-11-27T00:44:11,997 adding 'lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml' 2025-11-27T00:44:11,998 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml' 2025-11-27T00:44:11,999 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml' 2025-11-27T00:44:12,000 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml' 2025-11-27T00:44:12,001 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml' 2025-11-27T00:44:12,002 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml' 2025-11-27T00:44:12,004 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml' 2025-11-27T00:44:12,005 adding 'lm_eval/tasks/global_mmlu/default/sw/utils.py' 2025-11-27T00:44:12,007 adding 'lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml' 2025-11-27T00:44:12,008 adding 'lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml' 2025-11-27T00:44:12,009 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml' 2025-11-27T00:44:12,010 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml' 2025-11-27T00:44:12,011 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml' 2025-11-27T00:44:12,012 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml' 2025-11-27T00:44:12,013 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml' 2025-11-27T00:44:12,014 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml' 2025-11-27T00:44:12,016 adding 'lm_eval/tasks/global_mmlu/default/yo/utils.py' 2025-11-27T00:44:12,017 adding 'lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml' 2025-11-27T00:44:12,019 adding 'lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml' 2025-11-27T00:44:12,020 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml' 2025-11-27T00:44:12,021 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml' 2025-11-27T00:44:12,022 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml' 2025-11-27T00:44:12,023 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml' 2025-11-27T00:44:12,025 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml' 2025-11-27T00:44:12,026 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml' 2025-11-27T00:44:12,027 adding 'lm_eval/tasks/global_mmlu/default/zh/utils.py' 2025-11-27T00:44:12,031 adding 'lm_eval/tasks/global_mmlu/full/am/_am_template_yaml' 2025-11-27T00:44:12,033 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml' 2025-11-27T00:44:12,034 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml' 2025-11-27T00:44:12,035 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml' 2025-11-27T00:44:12,036 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml' 2025-11-27T00:44:12,037 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml' 2025-11-27T00:44:12,039 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml' 2025-11-27T00:44:12,040 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml' 2025-11-27T00:44:12,041 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml' 2025-11-27T00:44:12,042 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml' 2025-11-27T00:44:12,043 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml' 2025-11-27T00:44:12,045 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml' 2025-11-27T00:44:12,046 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml' 2025-11-27T00:44:12,047 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml' 2025-11-27T00:44:12,048 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml' 2025-11-27T00:44:12,049 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml' 2025-11-27T00:44:12,050 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml' 2025-11-27T00:44:12,052 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml' 2025-11-27T00:44:12,053 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml' 2025-11-27T00:44:12,054 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml' 2025-11-27T00:44:12,055 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml' 2025-11-27T00:44:12,056 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml' 2025-11-27T00:44:12,058 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml' 2025-11-27T00:44:12,059 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml' 2025-11-27T00:44:12,060 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml' 2025-11-27T00:44:12,061 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml' 2025-11-27T00:44:12,062 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml' 2025-11-27T00:44:12,063 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml' 2025-11-27T00:44:12,064 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml' 2025-11-27T00:44:12,065 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,066 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,068 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml' 2025-11-27T00:44:12,069 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml' 2025-11-27T00:44:12,070 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml' 2025-11-27T00:44:12,071 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml' 2025-11-27T00:44:12,072 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml' 2025-11-27T00:44:12,073 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml' 2025-11-27T00:44:12,075 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml' 2025-11-27T00:44:12,076 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml' 2025-11-27T00:44:12,077 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml' 2025-11-27T00:44:12,078 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml' 2025-11-27T00:44:12,079 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml' 2025-11-27T00:44:12,081 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml' 2025-11-27T00:44:12,082 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml' 2025-11-27T00:44:12,083 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml' 2025-11-27T00:44:12,084 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml' 2025-11-27T00:44:12,085 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml' 2025-11-27T00:44:12,087 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml' 2025-11-27T00:44:12,088 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml' 2025-11-27T00:44:12,089 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml' 2025-11-27T00:44:12,090 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml' 2025-11-27T00:44:12,091 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml' 2025-11-27T00:44:12,092 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml' 2025-11-27T00:44:12,093 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml' 2025-11-27T00:44:12,095 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml' 2025-11-27T00:44:12,096 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml' 2025-11-27T00:44:12,097 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml' 2025-11-27T00:44:12,098 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml' 2025-11-27T00:44:12,099 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml' 2025-11-27T00:44:12,101 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml' 2025-11-27T00:44:12,102 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml' 2025-11-27T00:44:12,103 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml' 2025-11-27T00:44:12,104 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml' 2025-11-27T00:44:12,105 adding 'lm_eval/tasks/global_mmlu/full/am/utils.py' 2025-11-27T00:44:12,109 adding 'lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml' 2025-11-27T00:44:12,110 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml' 2025-11-27T00:44:12,111 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml' 2025-11-27T00:44:12,112 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml' 2025-11-27T00:44:12,113 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml' 2025-11-27T00:44:12,114 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml' 2025-11-27T00:44:12,116 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml' 2025-11-27T00:44:12,117 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml' 2025-11-27T00:44:12,118 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml' 2025-11-27T00:44:12,119 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml' 2025-11-27T00:44:12,120 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml' 2025-11-27T00:44:12,122 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml' 2025-11-27T00:44:12,123 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml' 2025-11-27T00:44:12,124 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml' 2025-11-27T00:44:12,125 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml' 2025-11-27T00:44:12,126 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml' 2025-11-27T00:44:12,127 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml' 2025-11-27T00:44:12,129 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml' 2025-11-27T00:44:12,130 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml' 2025-11-27T00:44:12,131 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml' 2025-11-27T00:44:12,132 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml' 2025-11-27T00:44:12,133 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml' 2025-11-27T00:44:12,134 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml' 2025-11-27T00:44:12,136 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml' 2025-11-27T00:44:12,137 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml' 2025-11-27T00:44:12,138 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml' 2025-11-27T00:44:12,139 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml' 2025-11-27T00:44:12,140 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml' 2025-11-27T00:44:12,141 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml' 2025-11-27T00:44:12,142 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,144 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,145 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml' 2025-11-27T00:44:12,146 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml' 2025-11-27T00:44:12,147 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml' 2025-11-27T00:44:12,148 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml' 2025-11-27T00:44:12,149 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml' 2025-11-27T00:44:12,150 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml' 2025-11-27T00:44:12,152 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml' 2025-11-27T00:44:12,153 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml' 2025-11-27T00:44:12,154 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml' 2025-11-27T00:44:12,155 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml' 2025-11-27T00:44:12,156 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml' 2025-11-27T00:44:12,157 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml' 2025-11-27T00:44:12,159 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml' 2025-11-27T00:44:12,160 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml' 2025-11-27T00:44:12,161 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml' 2025-11-27T00:44:12,162 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml' 2025-11-27T00:44:12,163 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml' 2025-11-27T00:44:12,164 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml' 2025-11-27T00:44:12,166 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml' 2025-11-27T00:44:12,167 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml' 2025-11-27T00:44:12,168 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml' 2025-11-27T00:44:12,169 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml' 2025-11-27T00:44:12,170 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml' 2025-11-27T00:44:12,171 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml' 2025-11-27T00:44:12,173 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml' 2025-11-27T00:44:12,174 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml' 2025-11-27T00:44:12,175 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml' 2025-11-27T00:44:12,176 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml' 2025-11-27T00:44:12,177 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml' 2025-11-27T00:44:12,178 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml' 2025-11-27T00:44:12,179 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml' 2025-11-27T00:44:12,181 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml' 2025-11-27T00:44:12,182 adding 'lm_eval/tasks/global_mmlu/full/ar/utils.py' 2025-11-27T00:44:12,186 adding 'lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml' 2025-11-27T00:44:12,187 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml' 2025-11-27T00:44:12,189 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml' 2025-11-27T00:44:12,190 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml' 2025-11-27T00:44:12,191 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml' 2025-11-27T00:44:12,192 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml' 2025-11-27T00:44:12,193 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml' 2025-11-27T00:44:12,194 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml' 2025-11-27T00:44:12,196 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml' 2025-11-27T00:44:12,197 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml' 2025-11-27T00:44:12,198 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml' 2025-11-27T00:44:12,199 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml' 2025-11-27T00:44:12,200 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml' 2025-11-27T00:44:12,201 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml' 2025-11-27T00:44:12,202 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml' 2025-11-27T00:44:12,203 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml' 2025-11-27T00:44:12,205 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml' 2025-11-27T00:44:12,206 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml' 2025-11-27T00:44:12,207 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml' 2025-11-27T00:44:12,208 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml' 2025-11-27T00:44:12,209 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml' 2025-11-27T00:44:12,211 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml' 2025-11-27T00:44:12,212 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml' 2025-11-27T00:44:12,213 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml' 2025-11-27T00:44:12,214 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml' 2025-11-27T00:44:12,215 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml' 2025-11-27T00:44:12,216 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml' 2025-11-27T00:44:12,218 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml' 2025-11-27T00:44:12,219 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml' 2025-11-27T00:44:12,220 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,221 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,222 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml' 2025-11-27T00:44:12,223 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml' 2025-11-27T00:44:12,225 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml' 2025-11-27T00:44:12,226 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml' 2025-11-27T00:44:12,227 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml' 2025-11-27T00:44:12,228 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml' 2025-11-27T00:44:12,229 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml' 2025-11-27T00:44:12,230 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml' 2025-11-27T00:44:12,231 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml' 2025-11-27T00:44:12,233 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml' 2025-11-27T00:44:12,234 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml' 2025-11-27T00:44:12,235 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml' 2025-11-27T00:44:12,236 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml' 2025-11-27T00:44:12,237 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml' 2025-11-27T00:44:12,238 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml' 2025-11-27T00:44:12,239 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml' 2025-11-27T00:44:12,241 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml' 2025-11-27T00:44:12,242 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml' 2025-11-27T00:44:12,243 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml' 2025-11-27T00:44:12,244 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml' 2025-11-27T00:44:12,245 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml' 2025-11-27T00:44:12,246 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml' 2025-11-27T00:44:12,248 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml' 2025-11-27T00:44:12,249 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml' 2025-11-27T00:44:12,250 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml' 2025-11-27T00:44:12,251 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml' 2025-11-27T00:44:12,252 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml' 2025-11-27T00:44:12,253 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml' 2025-11-27T00:44:12,255 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml' 2025-11-27T00:44:12,256 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml' 2025-11-27T00:44:12,257 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml' 2025-11-27T00:44:12,258 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml' 2025-11-27T00:44:12,259 adding 'lm_eval/tasks/global_mmlu/full/bn/utils.py' 2025-11-27T00:44:12,263 adding 'lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml' 2025-11-27T00:44:12,264 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml' 2025-11-27T00:44:12,265 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml' 2025-11-27T00:44:12,266 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml' 2025-11-27T00:44:12,267 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml' 2025-11-27T00:44:12,269 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml' 2025-11-27T00:44:12,270 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml' 2025-11-27T00:44:12,271 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml' 2025-11-27T00:44:12,272 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml' 2025-11-27T00:44:12,273 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml' 2025-11-27T00:44:12,274 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml' 2025-11-27T00:44:12,275 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml' 2025-11-27T00:44:12,276 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml' 2025-11-27T00:44:12,278 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml' 2025-11-27T00:44:12,279 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml' 2025-11-27T00:44:12,280 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml' 2025-11-27T00:44:12,281 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml' 2025-11-27T00:44:12,282 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml' 2025-11-27T00:44:12,283 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml' 2025-11-27T00:44:12,284 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml' 2025-11-27T00:44:12,286 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml' 2025-11-27T00:44:12,287 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml' 2025-11-27T00:44:12,288 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml' 2025-11-27T00:44:12,289 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml' 2025-11-27T00:44:12,290 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml' 2025-11-27T00:44:12,291 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml' 2025-11-27T00:44:12,293 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml' 2025-11-27T00:44:12,294 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml' 2025-11-27T00:44:12,296 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml' 2025-11-27T00:44:12,298 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,299 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,300 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml' 2025-11-27T00:44:12,301 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml' 2025-11-27T00:44:12,303 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml' 2025-11-27T00:44:12,304 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml' 2025-11-27T00:44:12,305 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml' 2025-11-27T00:44:12,306 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml' 2025-11-27T00:44:12,307 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml' 2025-11-27T00:44:12,309 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml' 2025-11-27T00:44:12,310 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml' 2025-11-27T00:44:12,311 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml' 2025-11-27T00:44:12,312 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml' 2025-11-27T00:44:12,313 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml' 2025-11-27T00:44:12,314 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml' 2025-11-27T00:44:12,315 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml' 2025-11-27T00:44:12,316 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml' 2025-11-27T00:44:12,318 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml' 2025-11-27T00:44:12,319 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml' 2025-11-27T00:44:12,320 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml' 2025-11-27T00:44:12,321 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml' 2025-11-27T00:44:12,322 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml' 2025-11-27T00:44:12,323 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml' 2025-11-27T00:44:12,324 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml' 2025-11-27T00:44:12,325 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml' 2025-11-27T00:44:12,327 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml' 2025-11-27T00:44:12,328 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml' 2025-11-27T00:44:12,329 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml' 2025-11-27T00:44:12,330 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml' 2025-11-27T00:44:12,331 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml' 2025-11-27T00:44:12,333 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml' 2025-11-27T00:44:12,334 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml' 2025-11-27T00:44:12,335 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml' 2025-11-27T00:44:12,336 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml' 2025-11-27T00:44:12,337 adding 'lm_eval/tasks/global_mmlu/full/cs/utils.py' 2025-11-27T00:44:12,340 adding 'lm_eval/tasks/global_mmlu/full/de/_de_template_yaml' 2025-11-27T00:44:12,341 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml' 2025-11-27T00:44:12,342 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml' 2025-11-27T00:44:12,343 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml' 2025-11-27T00:44:12,344 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml' 2025-11-27T00:44:12,346 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml' 2025-11-27T00:44:12,347 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml' 2025-11-27T00:44:12,348 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml' 2025-11-27T00:44:12,349 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml' 2025-11-27T00:44:12,350 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml' 2025-11-27T00:44:12,351 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml' 2025-11-27T00:44:12,353 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml' 2025-11-27T00:44:12,354 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml' 2025-11-27T00:44:12,355 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml' 2025-11-27T00:44:12,356 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml' 2025-11-27T00:44:12,357 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml' 2025-11-27T00:44:12,359 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml' 2025-11-27T00:44:12,360 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml' 2025-11-27T00:44:12,361 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml' 2025-11-27T00:44:12,362 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml' 2025-11-27T00:44:12,363 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml' 2025-11-27T00:44:12,365 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml' 2025-11-27T00:44:12,366 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml' 2025-11-27T00:44:12,368 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml' 2025-11-27T00:44:12,369 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml' 2025-11-27T00:44:12,371 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml' 2025-11-27T00:44:12,372 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml' 2025-11-27T00:44:12,373 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml' 2025-11-27T00:44:12,374 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml' 2025-11-27T00:44:12,375 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,376 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,377 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml' 2025-11-27T00:44:12,379 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml' 2025-11-27T00:44:12,380 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml' 2025-11-27T00:44:12,381 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml' 2025-11-27T00:44:12,382 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml' 2025-11-27T00:44:12,383 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml' 2025-11-27T00:44:12,384 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml' 2025-11-27T00:44:12,385 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml' 2025-11-27T00:44:12,386 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml' 2025-11-27T00:44:12,388 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml' 2025-11-27T00:44:12,389 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml' 2025-11-27T00:44:12,390 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml' 2025-11-27T00:44:12,391 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml' 2025-11-27T00:44:12,392 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml' 2025-11-27T00:44:12,394 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml' 2025-11-27T00:44:12,395 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml' 2025-11-27T00:44:12,396 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml' 2025-11-27T00:44:12,397 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml' 2025-11-27T00:44:12,399 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml' 2025-11-27T00:44:12,400 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml' 2025-11-27T00:44:12,401 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml' 2025-11-27T00:44:12,402 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml' 2025-11-27T00:44:12,404 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml' 2025-11-27T00:44:12,405 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml' 2025-11-27T00:44:12,407 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml' 2025-11-27T00:44:12,408 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml' 2025-11-27T00:44:12,410 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml' 2025-11-27T00:44:12,411 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml' 2025-11-27T00:44:12,412 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml' 2025-11-27T00:44:12,413 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml' 2025-11-27T00:44:12,414 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml' 2025-11-27T00:44:12,416 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml' 2025-11-27T00:44:12,417 adding 'lm_eval/tasks/global_mmlu/full/de/utils.py' 2025-11-27T00:44:12,420 adding 'lm_eval/tasks/global_mmlu/full/el/_el_template_yaml' 2025-11-27T00:44:12,421 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml' 2025-11-27T00:44:12,422 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml' 2025-11-27T00:44:12,423 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml' 2025-11-27T00:44:12,424 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml' 2025-11-27T00:44:12,425 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml' 2025-11-27T00:44:12,426 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml' 2025-11-27T00:44:12,428 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml' 2025-11-27T00:44:12,429 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml' 2025-11-27T00:44:12,430 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml' 2025-11-27T00:44:12,431 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml' 2025-11-27T00:44:12,433 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml' 2025-11-27T00:44:12,434 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml' 2025-11-27T00:44:12,435 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml' 2025-11-27T00:44:12,436 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml' 2025-11-27T00:44:12,437 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml' 2025-11-27T00:44:12,438 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml' 2025-11-27T00:44:12,439 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml' 2025-11-27T00:44:12,441 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml' 2025-11-27T00:44:12,442 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml' 2025-11-27T00:44:12,444 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml' 2025-11-27T00:44:12,445 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml' 2025-11-27T00:44:12,446 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml' 2025-11-27T00:44:12,448 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml' 2025-11-27T00:44:12,449 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml' 2025-11-27T00:44:12,451 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml' 2025-11-27T00:44:12,452 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml' 2025-11-27T00:44:12,454 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml' 2025-11-27T00:44:12,455 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml' 2025-11-27T00:44:12,456 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,457 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,459 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml' 2025-11-27T00:44:12,460 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml' 2025-11-27T00:44:12,461 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml' 2025-11-27T00:44:12,462 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml' 2025-11-27T00:44:12,463 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml' 2025-11-27T00:44:12,464 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml' 2025-11-27T00:44:12,465 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml' 2025-11-27T00:44:12,466 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml' 2025-11-27T00:44:12,468 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml' 2025-11-27T00:44:12,469 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml' 2025-11-27T00:44:12,470 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml' 2025-11-27T00:44:12,471 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml' 2025-11-27T00:44:12,473 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml' 2025-11-27T00:44:12,474 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml' 2025-11-27T00:44:12,475 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml' 2025-11-27T00:44:12,476 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml' 2025-11-27T00:44:12,477 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml' 2025-11-27T00:44:12,478 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml' 2025-11-27T00:44:12,479 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml' 2025-11-27T00:44:12,481 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml' 2025-11-27T00:44:12,482 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml' 2025-11-27T00:44:12,483 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml' 2025-11-27T00:44:12,484 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml' 2025-11-27T00:44:12,485 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml' 2025-11-27T00:44:12,486 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml' 2025-11-27T00:44:12,487 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml' 2025-11-27T00:44:12,489 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml' 2025-11-27T00:44:12,490 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml' 2025-11-27T00:44:12,491 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml' 2025-11-27T00:44:12,492 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml' 2025-11-27T00:44:12,493 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml' 2025-11-27T00:44:12,494 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml' 2025-11-27T00:44:12,496 adding 'lm_eval/tasks/global_mmlu/full/el/utils.py' 2025-11-27T00:44:12,499 adding 'lm_eval/tasks/global_mmlu/full/en/_en_template_yaml' 2025-11-27T00:44:12,500 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml' 2025-11-27T00:44:12,501 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml' 2025-11-27T00:44:12,502 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml' 2025-11-27T00:44:12,503 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml' 2025-11-27T00:44:12,504 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml' 2025-11-27T00:44:12,505 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml' 2025-11-27T00:44:12,506 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml' 2025-11-27T00:44:12,507 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml' 2025-11-27T00:44:12,509 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml' 2025-11-27T00:44:12,510 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml' 2025-11-27T00:44:12,511 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml' 2025-11-27T00:44:12,512 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml' 2025-11-27T00:44:12,513 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml' 2025-11-27T00:44:12,514 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml' 2025-11-27T00:44:12,515 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml' 2025-11-27T00:44:12,516 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml' 2025-11-27T00:44:12,517 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml' 2025-11-27T00:44:12,519 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml' 2025-11-27T00:44:12,520 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml' 2025-11-27T00:44:12,521 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml' 2025-11-27T00:44:12,522 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml' 2025-11-27T00:44:12,523 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml' 2025-11-27T00:44:12,524 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml' 2025-11-27T00:44:12,526 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml' 2025-11-27T00:44:12,527 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml' 2025-11-27T00:44:12,528 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml' 2025-11-27T00:44:12,529 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml' 2025-11-27T00:44:12,530 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml' 2025-11-27T00:44:12,531 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,532 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,534 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml' 2025-11-27T00:44:12,535 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml' 2025-11-27T00:44:12,536 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml' 2025-11-27T00:44:12,537 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml' 2025-11-27T00:44:12,538 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml' 2025-11-27T00:44:12,539 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml' 2025-11-27T00:44:12,540 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml' 2025-11-27T00:44:12,542 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml' 2025-11-27T00:44:12,543 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml' 2025-11-27T00:44:12,544 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml' 2025-11-27T00:44:12,545 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml' 2025-11-27T00:44:12,546 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml' 2025-11-27T00:44:12,547 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml' 2025-11-27T00:44:12,548 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml' 2025-11-27T00:44:12,549 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml' 2025-11-27T00:44:12,551 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml' 2025-11-27T00:44:12,552 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml' 2025-11-27T00:44:12,553 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml' 2025-11-27T00:44:12,554 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml' 2025-11-27T00:44:12,555 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml' 2025-11-27T00:44:12,556 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml' 2025-11-27T00:44:12,557 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml' 2025-11-27T00:44:12,558 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml' 2025-11-27T00:44:12,560 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml' 2025-11-27T00:44:12,561 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml' 2025-11-27T00:44:12,562 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml' 2025-11-27T00:44:12,563 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml' 2025-11-27T00:44:12,564 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml' 2025-11-27T00:44:12,565 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml' 2025-11-27T00:44:12,567 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml' 2025-11-27T00:44:12,568 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml' 2025-11-27T00:44:12,569 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml' 2025-11-27T00:44:12,570 adding 'lm_eval/tasks/global_mmlu/full/en/utils.py' 2025-11-27T00:44:12,573 adding 'lm_eval/tasks/global_mmlu/full/es/_es_template_yaml' 2025-11-27T00:44:12,574 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml' 2025-11-27T00:44:12,576 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml' 2025-11-27T00:44:12,577 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml' 2025-11-27T00:44:12,578 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml' 2025-11-27T00:44:12,579 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml' 2025-11-27T00:44:12,580 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml' 2025-11-27T00:44:12,581 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml' 2025-11-27T00:44:12,583 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml' 2025-11-27T00:44:12,584 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml' 2025-11-27T00:44:12,585 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml' 2025-11-27T00:44:12,586 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml' 2025-11-27T00:44:12,587 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml' 2025-11-27T00:44:12,588 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml' 2025-11-27T00:44:12,589 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml' 2025-11-27T00:44:12,590 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml' 2025-11-27T00:44:12,591 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml' 2025-11-27T00:44:12,593 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml' 2025-11-27T00:44:12,594 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml' 2025-11-27T00:44:12,595 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml' 2025-11-27T00:44:12,596 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml' 2025-11-27T00:44:12,597 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml' 2025-11-27T00:44:12,598 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml' 2025-11-27T00:44:12,600 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml' 2025-11-27T00:44:12,601 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml' 2025-11-27T00:44:12,602 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml' 2025-11-27T00:44:12,603 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml' 2025-11-27T00:44:12,604 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml' 2025-11-27T00:44:12,605 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml' 2025-11-27T00:44:12,606 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,608 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,609 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml' 2025-11-27T00:44:12,610 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml' 2025-11-27T00:44:12,611 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml' 2025-11-27T00:44:12,612 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml' 2025-11-27T00:44:12,613 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml' 2025-11-27T00:44:12,615 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml' 2025-11-27T00:44:12,616 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml' 2025-11-27T00:44:12,617 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml' 2025-11-27T00:44:12,618 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml' 2025-11-27T00:44:12,619 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml' 2025-11-27T00:44:12,620 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml' 2025-11-27T00:44:12,622 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml' 2025-11-27T00:44:12,623 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml' 2025-11-27T00:44:12,624 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml' 2025-11-27T00:44:12,625 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml' 2025-11-27T00:44:12,626 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml' 2025-11-27T00:44:12,627 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml' 2025-11-27T00:44:12,628 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml' 2025-11-27T00:44:12,629 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml' 2025-11-27T00:44:12,630 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml' 2025-11-27T00:44:12,631 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml' 2025-11-27T00:44:12,633 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml' 2025-11-27T00:44:12,634 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml' 2025-11-27T00:44:12,635 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml' 2025-11-27T00:44:12,636 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml' 2025-11-27T00:44:12,637 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml' 2025-11-27T00:44:12,638 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml' 2025-11-27T00:44:12,639 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml' 2025-11-27T00:44:12,641 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml' 2025-11-27T00:44:12,642 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml' 2025-11-27T00:44:12,643 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml' 2025-11-27T00:44:12,644 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml' 2025-11-27T00:44:12,645 adding 'lm_eval/tasks/global_mmlu/full/es/utils.py' 2025-11-27T00:44:12,648 adding 'lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml' 2025-11-27T00:44:12,650 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml' 2025-11-27T00:44:12,651 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml' 2025-11-27T00:44:12,652 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml' 2025-11-27T00:44:12,653 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml' 2025-11-27T00:44:12,654 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml' 2025-11-27T00:44:12,655 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml' 2025-11-27T00:44:12,656 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml' 2025-11-27T00:44:12,658 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml' 2025-11-27T00:44:12,659 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml' 2025-11-27T00:44:12,660 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml' 2025-11-27T00:44:12,661 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml' 2025-11-27T00:44:12,662 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml' 2025-11-27T00:44:12,663 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml' 2025-11-27T00:44:12,665 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml' 2025-11-27T00:44:12,666 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml' 2025-11-27T00:44:12,667 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml' 2025-11-27T00:44:12,668 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml' 2025-11-27T00:44:12,669 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml' 2025-11-27T00:44:12,670 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml' 2025-11-27T00:44:12,671 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml' 2025-11-27T00:44:12,673 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml' 2025-11-27T00:44:12,674 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml' 2025-11-27T00:44:12,675 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml' 2025-11-27T00:44:12,676 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml' 2025-11-27T00:44:12,677 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml' 2025-11-27T00:44:12,678 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml' 2025-11-27T00:44:12,679 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml' 2025-11-27T00:44:12,680 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml' 2025-11-27T00:44:12,682 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,683 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,684 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml' 2025-11-27T00:44:12,685 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml' 2025-11-27T00:44:12,686 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml' 2025-11-27T00:44:12,687 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml' 2025-11-27T00:44:12,688 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml' 2025-11-27T00:44:12,689 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml' 2025-11-27T00:44:12,691 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml' 2025-11-27T00:44:12,692 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml' 2025-11-27T00:44:12,693 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml' 2025-11-27T00:44:12,694 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml' 2025-11-27T00:44:12,695 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml' 2025-11-27T00:44:12,696 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml' 2025-11-27T00:44:12,697 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml' 2025-11-27T00:44:12,699 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml' 2025-11-27T00:44:12,700 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml' 2025-11-27T00:44:12,701 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml' 2025-11-27T00:44:12,702 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml' 2025-11-27T00:44:12,703 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml' 2025-11-27T00:44:12,704 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml' 2025-11-27T00:44:12,706 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml' 2025-11-27T00:44:12,707 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml' 2025-11-27T00:44:12,708 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml' 2025-11-27T00:44:12,709 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml' 2025-11-27T00:44:12,710 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml' 2025-11-27T00:44:12,711 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml' 2025-11-27T00:44:12,712 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml' 2025-11-27T00:44:12,714 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml' 2025-11-27T00:44:12,715 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml' 2025-11-27T00:44:12,716 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml' 2025-11-27T00:44:12,718 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml' 2025-11-27T00:44:12,719 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml' 2025-11-27T00:44:12,720 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml' 2025-11-27T00:44:12,721 adding 'lm_eval/tasks/global_mmlu/full/fa/utils.py' 2025-11-27T00:44:12,724 adding 'lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml' 2025-11-27T00:44:12,725 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml' 2025-11-27T00:44:12,727 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml' 2025-11-27T00:44:12,728 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml' 2025-11-27T00:44:12,729 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml' 2025-11-27T00:44:12,730 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml' 2025-11-27T00:44:12,731 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml' 2025-11-27T00:44:12,733 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml' 2025-11-27T00:44:12,734 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml' 2025-11-27T00:44:12,735 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml' 2025-11-27T00:44:12,736 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml' 2025-11-27T00:44:12,737 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml' 2025-11-27T00:44:12,739 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml' 2025-11-27T00:44:12,740 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml' 2025-11-27T00:44:12,741 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml' 2025-11-27T00:44:12,742 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml' 2025-11-27T00:44:12,743 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml' 2025-11-27T00:44:12,744 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml' 2025-11-27T00:44:12,746 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml' 2025-11-27T00:44:12,747 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml' 2025-11-27T00:44:12,748 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml' 2025-11-27T00:44:12,749 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml' 2025-11-27T00:44:12,750 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml' 2025-11-27T00:44:12,752 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml' 2025-11-27T00:44:12,753 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml' 2025-11-27T00:44:12,754 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml' 2025-11-27T00:44:12,755 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml' 2025-11-27T00:44:12,756 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml' 2025-11-27T00:44:12,758 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml' 2025-11-27T00:44:12,759 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,760 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,761 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml' 2025-11-27T00:44:12,762 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml' 2025-11-27T00:44:12,763 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml' 2025-11-27T00:44:12,764 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml' 2025-11-27T00:44:12,765 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml' 2025-11-27T00:44:12,766 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml' 2025-11-27T00:44:12,768 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml' 2025-11-27T00:44:12,769 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml' 2025-11-27T00:44:12,770 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml' 2025-11-27T00:44:12,771 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml' 2025-11-27T00:44:12,772 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml' 2025-11-27T00:44:12,773 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml' 2025-11-27T00:44:12,774 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml' 2025-11-27T00:44:12,775 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml' 2025-11-27T00:44:12,777 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml' 2025-11-27T00:44:12,778 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml' 2025-11-27T00:44:12,779 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml' 2025-11-27T00:44:12,780 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml' 2025-11-27T00:44:12,781 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml' 2025-11-27T00:44:12,782 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml' 2025-11-27T00:44:12,784 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml' 2025-11-27T00:44:12,785 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml' 2025-11-27T00:44:12,786 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml' 2025-11-27T00:44:12,787 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml' 2025-11-27T00:44:12,788 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml' 2025-11-27T00:44:12,789 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml' 2025-11-27T00:44:12,790 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml' 2025-11-27T00:44:12,791 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml' 2025-11-27T00:44:12,793 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml' 2025-11-27T00:44:12,794 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml' 2025-11-27T00:44:12,795 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml' 2025-11-27T00:44:12,796 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml' 2025-11-27T00:44:12,797 adding 'lm_eval/tasks/global_mmlu/full/fil/utils.py' 2025-11-27T00:44:12,800 adding 'lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml' 2025-11-27T00:44:12,802 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml' 2025-11-27T00:44:12,803 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml' 2025-11-27T00:44:12,804 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml' 2025-11-27T00:44:12,805 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml' 2025-11-27T00:44:12,806 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml' 2025-11-27T00:44:12,807 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml' 2025-11-27T00:44:12,808 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml' 2025-11-27T00:44:12,809 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml' 2025-11-27T00:44:12,810 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml' 2025-11-27T00:44:12,811 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml' 2025-11-27T00:44:12,812 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml' 2025-11-27T00:44:12,814 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml' 2025-11-27T00:44:12,815 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml' 2025-11-27T00:44:12,816 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml' 2025-11-27T00:44:12,817 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml' 2025-11-27T00:44:12,818 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml' 2025-11-27T00:44:12,819 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml' 2025-11-27T00:44:12,820 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml' 2025-11-27T00:44:12,821 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml' 2025-11-27T00:44:12,823 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml' 2025-11-27T00:44:12,824 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml' 2025-11-27T00:44:12,825 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml' 2025-11-27T00:44:12,826 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml' 2025-11-27T00:44:12,827 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml' 2025-11-27T00:44:12,828 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml' 2025-11-27T00:44:12,830 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml' 2025-11-27T00:44:12,831 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml' 2025-11-27T00:44:12,832 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml' 2025-11-27T00:44:12,833 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,834 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,836 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml' 2025-11-27T00:44:12,837 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml' 2025-11-27T00:44:12,838 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml' 2025-11-27T00:44:12,839 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml' 2025-11-27T00:44:12,840 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml' 2025-11-27T00:44:12,842 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml' 2025-11-27T00:44:12,843 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml' 2025-11-27T00:44:12,844 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml' 2025-11-27T00:44:12,845 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml' 2025-11-27T00:44:12,846 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml' 2025-11-27T00:44:12,847 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml' 2025-11-27T00:44:12,848 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml' 2025-11-27T00:44:12,849 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml' 2025-11-27T00:44:12,850 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml' 2025-11-27T00:44:12,851 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml' 2025-11-27T00:44:12,852 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml' 2025-11-27T00:44:12,854 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml' 2025-11-27T00:44:12,855 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml' 2025-11-27T00:44:12,856 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml' 2025-11-27T00:44:12,857 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml' 2025-11-27T00:44:12,858 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml' 2025-11-27T00:44:12,859 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml' 2025-11-27T00:44:12,860 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml' 2025-11-27T00:44:12,861 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml' 2025-11-27T00:44:12,863 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml' 2025-11-27T00:44:12,864 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml' 2025-11-27T00:44:12,865 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml' 2025-11-27T00:44:12,866 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml' 2025-11-27T00:44:12,867 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml' 2025-11-27T00:44:12,868 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml' 2025-11-27T00:44:12,870 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml' 2025-11-27T00:44:12,871 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml' 2025-11-27T00:44:12,872 adding 'lm_eval/tasks/global_mmlu/full/fr/utils.py' 2025-11-27T00:44:12,875 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml' 2025-11-27T00:44:12,876 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml' 2025-11-27T00:44:12,878 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml' 2025-11-27T00:44:12,879 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml' 2025-11-27T00:44:12,880 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml' 2025-11-27T00:44:12,881 adding 'lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml' 2025-11-27T00:44:12,882 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml' 2025-11-27T00:44:12,883 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml' 2025-11-27T00:44:12,885 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml' 2025-11-27T00:44:12,886 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml' 2025-11-27T00:44:12,887 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml' 2025-11-27T00:44:12,888 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml' 2025-11-27T00:44:12,889 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml' 2025-11-27T00:44:12,890 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml' 2025-11-27T00:44:12,891 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml' 2025-11-27T00:44:12,892 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml' 2025-11-27T00:44:12,893 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml' 2025-11-27T00:44:12,894 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml' 2025-11-27T00:44:12,896 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml' 2025-11-27T00:44:12,897 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml' 2025-11-27T00:44:12,898 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml' 2025-11-27T00:44:12,899 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml' 2025-11-27T00:44:12,900 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml' 2025-11-27T00:44:12,901 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml' 2025-11-27T00:44:12,903 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml' 2025-11-27T00:44:12,904 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml' 2025-11-27T00:44:12,905 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml' 2025-11-27T00:44:12,906 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml' 2025-11-27T00:44:12,907 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml' 2025-11-27T00:44:12,908 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,909 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,910 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml' 2025-11-27T00:44:12,911 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml' 2025-11-27T00:44:12,913 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml' 2025-11-27T00:44:12,914 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml' 2025-11-27T00:44:12,915 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml' 2025-11-27T00:44:12,916 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml' 2025-11-27T00:44:12,917 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml' 2025-11-27T00:44:12,919 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml' 2025-11-27T00:44:12,920 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml' 2025-11-27T00:44:12,921 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml' 2025-11-27T00:44:12,922 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml' 2025-11-27T00:44:12,923 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml' 2025-11-27T00:44:12,924 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml' 2025-11-27T00:44:12,925 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml' 2025-11-27T00:44:12,927 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml' 2025-11-27T00:44:12,928 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml' 2025-11-27T00:44:12,929 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml' 2025-11-27T00:44:12,930 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml' 2025-11-27T00:44:12,931 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml' 2025-11-27T00:44:12,932 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml' 2025-11-27T00:44:12,933 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml' 2025-11-27T00:44:12,934 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml' 2025-11-27T00:44:12,935 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml' 2025-11-27T00:44:12,936 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml' 2025-11-27T00:44:12,938 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml' 2025-11-27T00:44:12,939 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml' 2025-11-27T00:44:12,940 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml' 2025-11-27T00:44:12,941 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml' 2025-11-27T00:44:12,942 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml' 2025-11-27T00:44:12,943 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml' 2025-11-27T00:44:12,944 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml' 2025-11-27T00:44:12,945 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml' 2025-11-27T00:44:12,947 adding 'lm_eval/tasks/global_mmlu/full/ha/utils.py' 2025-11-27T00:44:12,950 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml' 2025-11-27T00:44:12,951 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml' 2025-11-27T00:44:12,952 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml' 2025-11-27T00:44:12,953 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml' 2025-11-27T00:44:12,954 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml' 2025-11-27T00:44:12,956 adding 'lm_eval/tasks/global_mmlu/full/he/_he_template_yaml' 2025-11-27T00:44:12,957 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml' 2025-11-27T00:44:12,958 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml' 2025-11-27T00:44:12,959 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml' 2025-11-27T00:44:12,960 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml' 2025-11-27T00:44:12,961 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml' 2025-11-27T00:44:12,963 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml' 2025-11-27T00:44:12,964 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml' 2025-11-27T00:44:12,965 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml' 2025-11-27T00:44:12,966 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml' 2025-11-27T00:44:12,967 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml' 2025-11-27T00:44:12,968 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml' 2025-11-27T00:44:12,970 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml' 2025-11-27T00:44:12,971 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml' 2025-11-27T00:44:12,972 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml' 2025-11-27T00:44:12,973 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml' 2025-11-27T00:44:12,974 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml' 2025-11-27T00:44:12,975 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml' 2025-11-27T00:44:12,976 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml' 2025-11-27T00:44:12,977 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml' 2025-11-27T00:44:12,979 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml' 2025-11-27T00:44:12,980 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml' 2025-11-27T00:44:12,981 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml' 2025-11-27T00:44:12,982 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml' 2025-11-27T00:44:12,983 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml' 2025-11-27T00:44:12,984 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml' 2025-11-27T00:44:12,985 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml' 2025-11-27T00:44:12,986 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml' 2025-11-27T00:44:12,987 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml' 2025-11-27T00:44:12,989 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml' 2025-11-27T00:44:12,990 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml' 2025-11-27T00:44:12,991 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml' 2025-11-27T00:44:12,992 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml' 2025-11-27T00:44:12,993 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml' 2025-11-27T00:44:12,994 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml' 2025-11-27T00:44:12,996 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml' 2025-11-27T00:44:12,997 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml' 2025-11-27T00:44:12,998 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml' 2025-11-27T00:44:12,999 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml' 2025-11-27T00:44:13,000 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml' 2025-11-27T00:44:13,001 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml' 2025-11-27T00:44:13,003 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml' 2025-11-27T00:44:13,004 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml' 2025-11-27T00:44:13,005 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml' 2025-11-27T00:44:13,006 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml' 2025-11-27T00:44:13,007 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml' 2025-11-27T00:44:13,008 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml' 2025-11-27T00:44:13,010 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml' 2025-11-27T00:44:13,011 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml' 2025-11-27T00:44:13,012 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml' 2025-11-27T00:44:13,013 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml' 2025-11-27T00:44:13,014 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml' 2025-11-27T00:44:13,016 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml' 2025-11-27T00:44:13,017 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml' 2025-11-27T00:44:13,018 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml' 2025-11-27T00:44:13,019 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml' 2025-11-27T00:44:13,020 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml' 2025-11-27T00:44:13,021 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml' 2025-11-27T00:44:13,022 adding 'lm_eval/tasks/global_mmlu/full/he/utils.py' 2025-11-27T00:44:13,025 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml' 2025-11-27T00:44:13,026 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml' 2025-11-27T00:44:13,027 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml' 2025-11-27T00:44:13,029 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml' 2025-11-27T00:44:13,030 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml' 2025-11-27T00:44:13,031 adding 'lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml' 2025-11-27T00:44:13,032 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml' 2025-11-27T00:44:13,033 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml' 2025-11-27T00:44:13,034 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml' 2025-11-27T00:44:13,035 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml' 2025-11-27T00:44:13,036 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml' 2025-11-27T00:44:13,038 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml' 2025-11-27T00:44:13,039 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml' 2025-11-27T00:44:13,040 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml' 2025-11-27T00:44:13,041 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml' 2025-11-27T00:44:13,042 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml' 2025-11-27T00:44:13,043 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml' 2025-11-27T00:44:13,045 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml' 2025-11-27T00:44:13,046 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml' 2025-11-27T00:44:13,047 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml' 2025-11-27T00:44:13,048 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml' 2025-11-27T00:44:13,049 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml' 2025-11-27T00:44:13,051 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml' 2025-11-27T00:44:13,052 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml' 2025-11-27T00:44:13,053 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml' 2025-11-27T00:44:13,054 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml' 2025-11-27T00:44:13,055 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml' 2025-11-27T00:44:13,056 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml' 2025-11-27T00:44:13,058 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml' 2025-11-27T00:44:13,059 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,060 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,061 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml' 2025-11-27T00:44:13,062 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml' 2025-11-27T00:44:13,063 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml' 2025-11-27T00:44:13,064 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml' 2025-11-27T00:44:13,065 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml' 2025-11-27T00:44:13,066 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml' 2025-11-27T00:44:13,068 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml' 2025-11-27T00:44:13,069 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml' 2025-11-27T00:44:13,070 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml' 2025-11-27T00:44:13,071 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml' 2025-11-27T00:44:13,072 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml' 2025-11-27T00:44:13,073 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml' 2025-11-27T00:44:13,074 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml' 2025-11-27T00:44:13,075 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml' 2025-11-27T00:44:13,077 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml' 2025-11-27T00:44:13,078 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml' 2025-11-27T00:44:13,079 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml' 2025-11-27T00:44:13,080 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml' 2025-11-27T00:44:13,081 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml' 2025-11-27T00:44:13,082 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml' 2025-11-27T00:44:13,083 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml' 2025-11-27T00:44:13,085 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml' 2025-11-27T00:44:13,086 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml' 2025-11-27T00:44:13,087 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml' 2025-11-27T00:44:13,088 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml' 2025-11-27T00:44:13,089 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml' 2025-11-27T00:44:13,090 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml' 2025-11-27T00:44:13,092 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml' 2025-11-27T00:44:13,093 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml' 2025-11-27T00:44:13,094 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml' 2025-11-27T00:44:13,095 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml' 2025-11-27T00:44:13,096 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml' 2025-11-27T00:44:13,098 adding 'lm_eval/tasks/global_mmlu/full/hi/utils.py' 2025-11-27T00:44:13,101 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml' 2025-11-27T00:44:13,102 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml' 2025-11-27T00:44:13,103 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml' 2025-11-27T00:44:13,104 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml' 2025-11-27T00:44:13,105 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml' 2025-11-27T00:44:13,107 adding 'lm_eval/tasks/global_mmlu/full/id/_id_template_yaml' 2025-11-27T00:44:13,108 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml' 2025-11-27T00:44:13,109 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml' 2025-11-27T00:44:13,110 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml' 2025-11-27T00:44:13,111 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml' 2025-11-27T00:44:13,112 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml' 2025-11-27T00:44:13,113 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml' 2025-11-27T00:44:13,114 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml' 2025-11-27T00:44:13,115 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml' 2025-11-27T00:44:13,116 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml' 2025-11-27T00:44:13,117 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml' 2025-11-27T00:44:13,119 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml' 2025-11-27T00:44:13,120 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml' 2025-11-27T00:44:13,121 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml' 2025-11-27T00:44:13,122 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml' 2025-11-27T00:44:13,123 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml' 2025-11-27T00:44:13,124 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml' 2025-11-27T00:44:13,126 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml' 2025-11-27T00:44:13,127 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml' 2025-11-27T00:44:13,128 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml' 2025-11-27T00:44:13,129 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml' 2025-11-27T00:44:13,130 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml' 2025-11-27T00:44:13,131 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml' 2025-11-27T00:44:13,133 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml' 2025-11-27T00:44:13,134 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,135 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,136 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml' 2025-11-27T00:44:13,137 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml' 2025-11-27T00:44:13,138 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml' 2025-11-27T00:44:13,140 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml' 2025-11-27T00:44:13,141 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml' 2025-11-27T00:44:13,142 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml' 2025-11-27T00:44:13,143 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml' 2025-11-27T00:44:13,144 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml' 2025-11-27T00:44:13,146 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml' 2025-11-27T00:44:13,147 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml' 2025-11-27T00:44:13,148 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml' 2025-11-27T00:44:13,149 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml' 2025-11-27T00:44:13,150 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml' 2025-11-27T00:44:13,151 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml' 2025-11-27T00:44:13,152 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml' 2025-11-27T00:44:13,153 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml' 2025-11-27T00:44:13,154 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml' 2025-11-27T00:44:13,156 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml' 2025-11-27T00:44:13,157 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml' 2025-11-27T00:44:13,158 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml' 2025-11-27T00:44:13,159 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml' 2025-11-27T00:44:13,160 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml' 2025-11-27T00:44:13,161 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml' 2025-11-27T00:44:13,162 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml' 2025-11-27T00:44:13,164 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml' 2025-11-27T00:44:13,165 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml' 2025-11-27T00:44:13,166 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml' 2025-11-27T00:44:13,167 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml' 2025-11-27T00:44:13,168 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml' 2025-11-27T00:44:13,169 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml' 2025-11-27T00:44:13,170 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml' 2025-11-27T00:44:13,172 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml' 2025-11-27T00:44:13,173 adding 'lm_eval/tasks/global_mmlu/full/id/utils.py' 2025-11-27T00:44:13,176 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml' 2025-11-27T00:44:13,177 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml' 2025-11-27T00:44:13,178 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml' 2025-11-27T00:44:13,179 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml' 2025-11-27T00:44:13,181 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml' 2025-11-27T00:44:13,182 adding 'lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml' 2025-11-27T00:44:13,183 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml' 2025-11-27T00:44:13,184 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml' 2025-11-27T00:44:13,185 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml' 2025-11-27T00:44:13,186 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml' 2025-11-27T00:44:13,188 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml' 2025-11-27T00:44:13,189 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml' 2025-11-27T00:44:13,190 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml' 2025-11-27T00:44:13,191 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml' 2025-11-27T00:44:13,193 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml' 2025-11-27T00:44:13,194 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml' 2025-11-27T00:44:13,195 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml' 2025-11-27T00:44:13,196 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml' 2025-11-27T00:44:13,197 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml' 2025-11-27T00:44:13,198 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml' 2025-11-27T00:44:13,199 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml' 2025-11-27T00:44:13,200 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml' 2025-11-27T00:44:13,201 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml' 2025-11-27T00:44:13,203 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml' 2025-11-27T00:44:13,204 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml' 2025-11-27T00:44:13,205 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml' 2025-11-27T00:44:13,206 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml' 2025-11-27T00:44:13,207 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml' 2025-11-27T00:44:13,208 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml' 2025-11-27T00:44:13,209 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,211 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,212 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml' 2025-11-27T00:44:13,213 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml' 2025-11-27T00:44:13,214 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml' 2025-11-27T00:44:13,215 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml' 2025-11-27T00:44:13,216 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml' 2025-11-27T00:44:13,217 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml' 2025-11-27T00:44:13,219 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml' 2025-11-27T00:44:13,220 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml' 2025-11-27T00:44:13,221 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml' 2025-11-27T00:44:13,222 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml' 2025-11-27T00:44:13,223 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml' 2025-11-27T00:44:13,224 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml' 2025-11-27T00:44:13,226 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml' 2025-11-27T00:44:13,227 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml' 2025-11-27T00:44:13,228 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml' 2025-11-27T00:44:13,229 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml' 2025-11-27T00:44:13,230 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml' 2025-11-27T00:44:13,232 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml' 2025-11-27T00:44:13,233 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml' 2025-11-27T00:44:13,234 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml' 2025-11-27T00:44:13,235 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml' 2025-11-27T00:44:13,236 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml' 2025-11-27T00:44:13,237 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml' 2025-11-27T00:44:13,238 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml' 2025-11-27T00:44:13,239 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml' 2025-11-27T00:44:13,240 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml' 2025-11-27T00:44:13,242 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml' 2025-11-27T00:44:13,243 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml' 2025-11-27T00:44:13,244 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml' 2025-11-27T00:44:13,245 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml' 2025-11-27T00:44:13,246 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml' 2025-11-27T00:44:13,247 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml' 2025-11-27T00:44:13,249 adding 'lm_eval/tasks/global_mmlu/full/ig/utils.py' 2025-11-27T00:44:13,252 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml' 2025-11-27T00:44:13,253 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml' 2025-11-27T00:44:13,254 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml' 2025-11-27T00:44:13,255 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml' 2025-11-27T00:44:13,256 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml' 2025-11-27T00:44:13,258 adding 'lm_eval/tasks/global_mmlu/full/it/_it_template_yaml' 2025-11-27T00:44:13,259 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml' 2025-11-27T00:44:13,260 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml' 2025-11-27T00:44:13,261 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml' 2025-11-27T00:44:13,262 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml' 2025-11-27T00:44:13,263 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml' 2025-11-27T00:44:13,265 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml' 2025-11-27T00:44:13,266 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml' 2025-11-27T00:44:13,267 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml' 2025-11-27T00:44:13,268 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml' 2025-11-27T00:44:13,269 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml' 2025-11-27T00:44:13,270 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml' 2025-11-27T00:44:13,272 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml' 2025-11-27T00:44:13,273 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml' 2025-11-27T00:44:13,274 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml' 2025-11-27T00:44:13,275 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml' 2025-11-27T00:44:13,276 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml' 2025-11-27T00:44:13,277 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml' 2025-11-27T00:44:13,279 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml' 2025-11-27T00:44:13,280 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml' 2025-11-27T00:44:13,281 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml' 2025-11-27T00:44:13,282 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml' 2025-11-27T00:44:13,283 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml' 2025-11-27T00:44:13,284 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml' 2025-11-27T00:44:13,285 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,287 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,288 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml' 2025-11-27T00:44:13,289 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml' 2025-11-27T00:44:13,290 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml' 2025-11-27T00:44:13,291 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml' 2025-11-27T00:44:13,292 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml' 2025-11-27T00:44:13,294 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml' 2025-11-27T00:44:13,295 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml' 2025-11-27T00:44:13,296 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml' 2025-11-27T00:44:13,297 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml' 2025-11-27T00:44:13,298 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml' 2025-11-27T00:44:13,299 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml' 2025-11-27T00:44:13,300 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml' 2025-11-27T00:44:13,302 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml' 2025-11-27T00:44:13,303 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml' 2025-11-27T00:44:13,304 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml' 2025-11-27T00:44:13,305 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml' 2025-11-27T00:44:13,306 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml' 2025-11-27T00:44:13,307 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml' 2025-11-27T00:44:13,309 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml' 2025-11-27T00:44:13,310 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml' 2025-11-27T00:44:13,311 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml' 2025-11-27T00:44:13,312 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml' 2025-11-27T00:44:13,313 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml' 2025-11-27T00:44:13,315 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml' 2025-11-27T00:44:13,316 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml' 2025-11-27T00:44:13,317 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml' 2025-11-27T00:44:13,318 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml' 2025-11-27T00:44:13,319 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml' 2025-11-27T00:44:13,320 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml' 2025-11-27T00:44:13,322 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml' 2025-11-27T00:44:13,323 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml' 2025-11-27T00:44:13,324 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml' 2025-11-27T00:44:13,325 adding 'lm_eval/tasks/global_mmlu/full/it/utils.py' 2025-11-27T00:44:13,328 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml' 2025-11-27T00:44:13,329 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml' 2025-11-27T00:44:13,330 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml' 2025-11-27T00:44:13,331 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml' 2025-11-27T00:44:13,332 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml' 2025-11-27T00:44:13,333 adding 'lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml' 2025-11-27T00:44:13,335 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml' 2025-11-27T00:44:13,336 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml' 2025-11-27T00:44:13,337 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml' 2025-11-27T00:44:13,338 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml' 2025-11-27T00:44:13,339 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml' 2025-11-27T00:44:13,340 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml' 2025-11-27T00:44:13,341 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml' 2025-11-27T00:44:13,342 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml' 2025-11-27T00:44:13,344 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml' 2025-11-27T00:44:13,345 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml' 2025-11-27T00:44:13,346 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml' 2025-11-27T00:44:13,347 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml' 2025-11-27T00:44:13,348 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml' 2025-11-27T00:44:13,349 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml' 2025-11-27T00:44:13,351 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml' 2025-11-27T00:44:13,352 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml' 2025-11-27T00:44:13,353 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml' 2025-11-27T00:44:13,354 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml' 2025-11-27T00:44:13,355 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml' 2025-11-27T00:44:13,356 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml' 2025-11-27T00:44:13,357 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml' 2025-11-27T00:44:13,359 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml' 2025-11-27T00:44:13,360 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml' 2025-11-27T00:44:13,361 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,362 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,363 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml' 2025-11-27T00:44:13,364 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml' 2025-11-27T00:44:13,366 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml' 2025-11-27T00:44:13,367 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml' 2025-11-27T00:44:13,368 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml' 2025-11-27T00:44:13,369 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml' 2025-11-27T00:44:13,370 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml' 2025-11-27T00:44:13,371 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml' 2025-11-27T00:44:13,372 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml' 2025-11-27T00:44:13,373 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml' 2025-11-27T00:44:13,374 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml' 2025-11-27T00:44:13,376 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml' 2025-11-27T00:44:13,377 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml' 2025-11-27T00:44:13,378 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml' 2025-11-27T00:44:13,379 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml' 2025-11-27T00:44:13,380 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml' 2025-11-27T00:44:13,381 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml' 2025-11-27T00:44:13,382 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml' 2025-11-27T00:44:13,383 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml' 2025-11-27T00:44:13,385 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml' 2025-11-27T00:44:13,386 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml' 2025-11-27T00:44:13,387 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml' 2025-11-27T00:44:13,388 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml' 2025-11-27T00:44:13,389 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml' 2025-11-27T00:44:13,390 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml' 2025-11-27T00:44:13,392 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml' 2025-11-27T00:44:13,393 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml' 2025-11-27T00:44:13,394 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml' 2025-11-27T00:44:13,395 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml' 2025-11-27T00:44:13,396 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml' 2025-11-27T00:44:13,397 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml' 2025-11-27T00:44:13,398 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml' 2025-11-27T00:44:13,400 adding 'lm_eval/tasks/global_mmlu/full/ja/utils.py' 2025-11-27T00:44:13,403 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml' 2025-11-27T00:44:13,404 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml' 2025-11-27T00:44:13,405 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml' 2025-11-27T00:44:13,406 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml' 2025-11-27T00:44:13,407 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml' 2025-11-27T00:44:13,408 adding 'lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml' 2025-11-27T00:44:13,410 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml' 2025-11-27T00:44:13,411 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml' 2025-11-27T00:44:13,412 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml' 2025-11-27T00:44:13,413 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml' 2025-11-27T00:44:13,414 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml' 2025-11-27T00:44:13,415 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml' 2025-11-27T00:44:13,416 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml' 2025-11-27T00:44:13,417 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml' 2025-11-27T00:44:13,418 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml' 2025-11-27T00:44:13,419 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml' 2025-11-27T00:44:13,421 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml' 2025-11-27T00:44:13,422 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml' 2025-11-27T00:44:13,423 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml' 2025-11-27T00:44:13,424 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml' 2025-11-27T00:44:13,425 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml' 2025-11-27T00:44:13,426 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml' 2025-11-27T00:44:13,427 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml' 2025-11-27T00:44:13,428 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml' 2025-11-27T00:44:13,429 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml' 2025-11-27T00:44:13,431 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml' 2025-11-27T00:44:13,432 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml' 2025-11-27T00:44:13,433 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml' 2025-11-27T00:44:13,434 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml' 2025-11-27T00:44:13,435 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,436 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,437 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml' 2025-11-27T00:44:13,439 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml' 2025-11-27T00:44:13,440 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml' 2025-11-27T00:44:13,441 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml' 2025-11-27T00:44:13,442 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml' 2025-11-27T00:44:13,443 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml' 2025-11-27T00:44:13,444 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml' 2025-11-27T00:44:13,445 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml' 2025-11-27T00:44:13,447 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml' 2025-11-27T00:44:13,448 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml' 2025-11-27T00:44:13,449 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml' 2025-11-27T00:44:13,450 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml' 2025-11-27T00:44:13,451 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml' 2025-11-27T00:44:13,452 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml' 2025-11-27T00:44:13,453 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml' 2025-11-27T00:44:13,455 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml' 2025-11-27T00:44:13,456 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml' 2025-11-27T00:44:13,457 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml' 2025-11-27T00:44:13,458 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml' 2025-11-27T00:44:13,459 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml' 2025-11-27T00:44:13,460 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml' 2025-11-27T00:44:13,461 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml' 2025-11-27T00:44:13,463 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml' 2025-11-27T00:44:13,464 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml' 2025-11-27T00:44:13,465 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml' 2025-11-27T00:44:13,466 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml' 2025-11-27T00:44:13,467 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml' 2025-11-27T00:44:13,468 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml' 2025-11-27T00:44:13,469 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml' 2025-11-27T00:44:13,471 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml' 2025-11-27T00:44:13,472 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml' 2025-11-27T00:44:13,473 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml' 2025-11-27T00:44:13,474 adding 'lm_eval/tasks/global_mmlu/full/ko/utils.py' 2025-11-27T00:44:13,477 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml' 2025-11-27T00:44:13,478 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml' 2025-11-27T00:44:13,480 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml' 2025-11-27T00:44:13,481 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml' 2025-11-27T00:44:13,482 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml' 2025-11-27T00:44:13,483 adding 'lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml' 2025-11-27T00:44:13,484 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml' 2025-11-27T00:44:13,485 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml' 2025-11-27T00:44:13,486 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml' 2025-11-27T00:44:13,488 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml' 2025-11-27T00:44:13,489 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml' 2025-11-27T00:44:13,490 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml' 2025-11-27T00:44:13,491 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml' 2025-11-27T00:44:13,492 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml' 2025-11-27T00:44:13,494 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml' 2025-11-27T00:44:13,495 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml' 2025-11-27T00:44:13,496 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml' 2025-11-27T00:44:13,497 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml' 2025-11-27T00:44:13,498 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml' 2025-11-27T00:44:13,499 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml' 2025-11-27T00:44:13,500 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml' 2025-11-27T00:44:13,501 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml' 2025-11-27T00:44:13,502 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml' 2025-11-27T00:44:13,504 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml' 2025-11-27T00:44:13,505 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml' 2025-11-27T00:44:13,506 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml' 2025-11-27T00:44:13,507 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml' 2025-11-27T00:44:13,508 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml' 2025-11-27T00:44:13,509 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml' 2025-11-27T00:44:13,510 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,512 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,513 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml' 2025-11-27T00:44:13,514 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml' 2025-11-27T00:44:13,515 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml' 2025-11-27T00:44:13,516 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml' 2025-11-27T00:44:13,517 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml' 2025-11-27T00:44:13,519 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml' 2025-11-27T00:44:13,520 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml' 2025-11-27T00:44:13,521 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml' 2025-11-27T00:44:13,522 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml' 2025-11-27T00:44:13,523 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml' 2025-11-27T00:44:13,524 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml' 2025-11-27T00:44:13,526 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml' 2025-11-27T00:44:13,527 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml' 2025-11-27T00:44:13,528 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml' 2025-11-27T00:44:13,529 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml' 2025-11-27T00:44:13,531 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml' 2025-11-27T00:44:13,532 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml' 2025-11-27T00:44:13,533 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml' 2025-11-27T00:44:13,534 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml' 2025-11-27T00:44:13,535 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml' 2025-11-27T00:44:13,536 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml' 2025-11-27T00:44:13,538 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml' 2025-11-27T00:44:13,539 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml' 2025-11-27T00:44:13,540 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml' 2025-11-27T00:44:13,541 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml' 2025-11-27T00:44:13,542 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml' 2025-11-27T00:44:13,543 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml' 2025-11-27T00:44:13,544 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml' 2025-11-27T00:44:13,545 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml' 2025-11-27T00:44:13,546 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml' 2025-11-27T00:44:13,547 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml' 2025-11-27T00:44:13,549 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml' 2025-11-27T00:44:13,550 adding 'lm_eval/tasks/global_mmlu/full/ky/utils.py' 2025-11-27T00:44:13,553 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml' 2025-11-27T00:44:13,554 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml' 2025-11-27T00:44:13,555 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml' 2025-11-27T00:44:13,556 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml' 2025-11-27T00:44:13,557 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml' 2025-11-27T00:44:13,559 adding 'lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml' 2025-11-27T00:44:13,560 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml' 2025-11-27T00:44:13,562 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml' 2025-11-27T00:44:13,563 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml' 2025-11-27T00:44:13,564 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml' 2025-11-27T00:44:13,566 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml' 2025-11-27T00:44:13,567 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml' 2025-11-27T00:44:13,569 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml' 2025-11-27T00:44:13,570 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml' 2025-11-27T00:44:13,571 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml' 2025-11-27T00:44:13,572 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml' 2025-11-27T00:44:13,573 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml' 2025-11-27T00:44:13,575 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml' 2025-11-27T00:44:13,576 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml' 2025-11-27T00:44:13,577 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml' 2025-11-27T00:44:13,578 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml' 2025-11-27T00:44:13,579 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml' 2025-11-27T00:44:13,581 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml' 2025-11-27T00:44:13,582 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml' 2025-11-27T00:44:13,583 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml' 2025-11-27T00:44:13,584 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml' 2025-11-27T00:44:13,585 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml' 2025-11-27T00:44:13,586 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml' 2025-11-27T00:44:13,587 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml' 2025-11-27T00:44:13,589 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,590 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,591 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml' 2025-11-27T00:44:13,592 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml' 2025-11-27T00:44:13,593 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml' 2025-11-27T00:44:13,594 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml' 2025-11-27T00:44:13,595 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml' 2025-11-27T00:44:13,596 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml' 2025-11-27T00:44:13,597 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml' 2025-11-27T00:44:13,599 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml' 2025-11-27T00:44:13,600 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml' 2025-11-27T00:44:13,601 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml' 2025-11-27T00:44:13,602 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml' 2025-11-27T00:44:13,604 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml' 2025-11-27T00:44:13,605 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml' 2025-11-27T00:44:13,607 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml' 2025-11-27T00:44:13,608 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml' 2025-11-27T00:44:13,610 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml' 2025-11-27T00:44:13,611 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml' 2025-11-27T00:44:13,612 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml' 2025-11-27T00:44:13,613 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml' 2025-11-27T00:44:13,614 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml' 2025-11-27T00:44:13,616 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml' 2025-11-27T00:44:13,617 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml' 2025-11-27T00:44:13,618 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml' 2025-11-27T00:44:13,619 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml' 2025-11-27T00:44:13,620 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml' 2025-11-27T00:44:13,622 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml' 2025-11-27T00:44:13,623 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml' 2025-11-27T00:44:13,624 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml' 2025-11-27T00:44:13,625 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml' 2025-11-27T00:44:13,626 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml' 2025-11-27T00:44:13,628 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml' 2025-11-27T00:44:13,629 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml' 2025-11-27T00:44:13,630 adding 'lm_eval/tasks/global_mmlu/full/lt/utils.py' 2025-11-27T00:44:13,633 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml' 2025-11-27T00:44:13,634 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml' 2025-11-27T00:44:13,635 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml' 2025-11-27T00:44:13,636 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml' 2025-11-27T00:44:13,637 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml' 2025-11-27T00:44:13,639 adding 'lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml' 2025-11-27T00:44:13,640 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml' 2025-11-27T00:44:13,641 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml' 2025-11-27T00:44:13,642 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml' 2025-11-27T00:44:13,644 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml' 2025-11-27T00:44:13,645 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml' 2025-11-27T00:44:13,647 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml' 2025-11-27T00:44:13,648 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml' 2025-11-27T00:44:13,649 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml' 2025-11-27T00:44:13,651 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml' 2025-11-27T00:44:13,652 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml' 2025-11-27T00:44:13,654 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml' 2025-11-27T00:44:13,655 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml' 2025-11-27T00:44:13,656 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml' 2025-11-27T00:44:13,657 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml' 2025-11-27T00:44:13,659 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml' 2025-11-27T00:44:13,660 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml' 2025-11-27T00:44:13,661 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml' 2025-11-27T00:44:13,662 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml' 2025-11-27T00:44:13,663 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml' 2025-11-27T00:44:13,664 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml' 2025-11-27T00:44:13,666 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml' 2025-11-27T00:44:13,667 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml' 2025-11-27T00:44:13,668 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml' 2025-11-27T00:44:13,669 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,670 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,671 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml' 2025-11-27T00:44:13,673 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml' 2025-11-27T00:44:13,674 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml' 2025-11-27T00:44:13,675 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml' 2025-11-27T00:44:13,676 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml' 2025-11-27T00:44:13,677 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml' 2025-11-27T00:44:13,679 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml' 2025-11-27T00:44:13,680 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml' 2025-11-27T00:44:13,681 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml' 2025-11-27T00:44:13,682 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml' 2025-11-27T00:44:13,683 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml' 2025-11-27T00:44:13,684 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml' 2025-11-27T00:44:13,685 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml' 2025-11-27T00:44:13,686 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml' 2025-11-27T00:44:13,687 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml' 2025-11-27T00:44:13,688 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml' 2025-11-27T00:44:13,690 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml' 2025-11-27T00:44:13,691 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml' 2025-11-27T00:44:13,692 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml' 2025-11-27T00:44:13,693 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml' 2025-11-27T00:44:13,694 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml' 2025-11-27T00:44:13,695 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml' 2025-11-27T00:44:13,696 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml' 2025-11-27T00:44:13,697 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml' 2025-11-27T00:44:13,699 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml' 2025-11-27T00:44:13,700 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml' 2025-11-27T00:44:13,701 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml' 2025-11-27T00:44:13,702 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml' 2025-11-27T00:44:13,703 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml' 2025-11-27T00:44:13,704 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml' 2025-11-27T00:44:13,705 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml' 2025-11-27T00:44:13,707 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml' 2025-11-27T00:44:13,708 adding 'lm_eval/tasks/global_mmlu/full/mg/utils.py' 2025-11-27T00:44:13,711 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml' 2025-11-27T00:44:13,712 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml' 2025-11-27T00:44:13,713 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml' 2025-11-27T00:44:13,714 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml' 2025-11-27T00:44:13,715 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml' 2025-11-27T00:44:13,717 adding 'lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml' 2025-11-27T00:44:13,718 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml' 2025-11-27T00:44:13,719 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml' 2025-11-27T00:44:13,720 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml' 2025-11-27T00:44:13,721 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml' 2025-11-27T00:44:13,722 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml' 2025-11-27T00:44:13,724 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml' 2025-11-27T00:44:13,725 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml' 2025-11-27T00:44:13,726 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml' 2025-11-27T00:44:13,727 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml' 2025-11-27T00:44:13,728 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml' 2025-11-27T00:44:13,729 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml' 2025-11-27T00:44:13,730 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml' 2025-11-27T00:44:13,731 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml' 2025-11-27T00:44:13,732 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml' 2025-11-27T00:44:13,733 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml' 2025-11-27T00:44:13,734 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml' 2025-11-27T00:44:13,736 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml' 2025-11-27T00:44:13,737 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml' 2025-11-27T00:44:13,738 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml' 2025-11-27T00:44:13,739 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml' 2025-11-27T00:44:13,740 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml' 2025-11-27T00:44:13,741 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml' 2025-11-27T00:44:13,743 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml' 2025-11-27T00:44:13,744 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,745 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,746 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml' 2025-11-27T00:44:13,747 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml' 2025-11-27T00:44:13,748 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml' 2025-11-27T00:44:13,750 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml' 2025-11-27T00:44:13,751 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml' 2025-11-27T00:44:13,752 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml' 2025-11-27T00:44:13,753 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml' 2025-11-27T00:44:13,754 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml' 2025-11-27T00:44:13,756 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml' 2025-11-27T00:44:13,757 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml' 2025-11-27T00:44:13,758 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml' 2025-11-27T00:44:13,759 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml' 2025-11-27T00:44:13,761 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml' 2025-11-27T00:44:13,762 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml' 2025-11-27T00:44:13,763 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml' 2025-11-27T00:44:13,764 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml' 2025-11-27T00:44:13,765 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml' 2025-11-27T00:44:13,766 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml' 2025-11-27T00:44:13,767 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml' 2025-11-27T00:44:13,768 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml' 2025-11-27T00:44:13,769 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml' 2025-11-27T00:44:13,771 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml' 2025-11-27T00:44:13,772 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml' 2025-11-27T00:44:13,773 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml' 2025-11-27T00:44:13,774 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml' 2025-11-27T00:44:13,775 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml' 2025-11-27T00:44:13,776 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml' 2025-11-27T00:44:13,777 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml' 2025-11-27T00:44:13,779 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml' 2025-11-27T00:44:13,780 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml' 2025-11-27T00:44:13,781 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml' 2025-11-27T00:44:13,782 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml' 2025-11-27T00:44:13,783 adding 'lm_eval/tasks/global_mmlu/full/ms/utils.py' 2025-11-27T00:44:13,786 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml' 2025-11-27T00:44:13,787 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml' 2025-11-27T00:44:13,789 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml' 2025-11-27T00:44:13,790 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml' 2025-11-27T00:44:13,791 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml' 2025-11-27T00:44:13,792 adding 'lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml' 2025-11-27T00:44:13,793 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml' 2025-11-27T00:44:13,794 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml' 2025-11-27T00:44:13,796 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml' 2025-11-27T00:44:13,797 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml' 2025-11-27T00:44:13,798 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml' 2025-11-27T00:44:13,799 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml' 2025-11-27T00:44:13,800 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml' 2025-11-27T00:44:13,802 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml' 2025-11-27T00:44:13,803 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml' 2025-11-27T00:44:13,804 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml' 2025-11-27T00:44:13,805 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml' 2025-11-27T00:44:13,806 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml' 2025-11-27T00:44:13,808 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml' 2025-11-27T00:44:13,809 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml' 2025-11-27T00:44:13,810 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml' 2025-11-27T00:44:13,811 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml' 2025-11-27T00:44:13,812 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml' 2025-11-27T00:44:13,813 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml' 2025-11-27T00:44:13,814 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml' 2025-11-27T00:44:13,815 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml' 2025-11-27T00:44:13,817 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml' 2025-11-27T00:44:13,818 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml' 2025-11-27T00:44:13,819 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml' 2025-11-27T00:44:13,820 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,821 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,822 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml' 2025-11-27T00:44:13,823 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml' 2025-11-27T00:44:13,824 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml' 2025-11-27T00:44:13,826 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml' 2025-11-27T00:44:13,827 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml' 2025-11-27T00:44:13,828 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml' 2025-11-27T00:44:13,829 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml' 2025-11-27T00:44:13,830 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml' 2025-11-27T00:44:13,831 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml' 2025-11-27T00:44:13,833 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml' 2025-11-27T00:44:13,834 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml' 2025-11-27T00:44:13,835 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml' 2025-11-27T00:44:13,836 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml' 2025-11-27T00:44:13,837 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml' 2025-11-27T00:44:13,838 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml' 2025-11-27T00:44:13,840 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml' 2025-11-27T00:44:13,841 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml' 2025-11-27T00:44:13,842 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml' 2025-11-27T00:44:13,843 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml' 2025-11-27T00:44:13,844 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml' 2025-11-27T00:44:13,845 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml' 2025-11-27T00:44:13,847 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml' 2025-11-27T00:44:13,848 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml' 2025-11-27T00:44:13,849 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml' 2025-11-27T00:44:13,850 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml' 2025-11-27T00:44:13,851 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml' 2025-11-27T00:44:13,852 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml' 2025-11-27T00:44:13,853 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml' 2025-11-27T00:44:13,854 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml' 2025-11-27T00:44:13,856 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml' 2025-11-27T00:44:13,857 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml' 2025-11-27T00:44:13,858 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml' 2025-11-27T00:44:13,859 adding 'lm_eval/tasks/global_mmlu/full/ne/utils.py' 2025-11-27T00:44:13,862 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml' 2025-11-27T00:44:13,863 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml' 2025-11-27T00:44:13,864 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml' 2025-11-27T00:44:13,866 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml' 2025-11-27T00:44:13,867 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml' 2025-11-27T00:44:13,868 adding 'lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml' 2025-11-27T00:44:13,869 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml' 2025-11-27T00:44:13,870 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml' 2025-11-27T00:44:13,871 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml' 2025-11-27T00:44:13,872 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml' 2025-11-27T00:44:13,874 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml' 2025-11-27T00:44:13,875 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml' 2025-11-27T00:44:13,876 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml' 2025-11-27T00:44:13,877 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml' 2025-11-27T00:44:13,878 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml' 2025-11-27T00:44:13,879 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml' 2025-11-27T00:44:13,880 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml' 2025-11-27T00:44:13,882 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml' 2025-11-27T00:44:13,883 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml' 2025-11-27T00:44:13,884 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml' 2025-11-27T00:44:13,885 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml' 2025-11-27T00:44:13,886 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml' 2025-11-27T00:44:13,887 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml' 2025-11-27T00:44:13,889 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml' 2025-11-27T00:44:13,890 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml' 2025-11-27T00:44:13,891 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml' 2025-11-27T00:44:13,892 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml' 2025-11-27T00:44:13,893 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml' 2025-11-27T00:44:13,895 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml' 2025-11-27T00:44:13,896 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,897 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,898 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml' 2025-11-27T00:44:13,899 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml' 2025-11-27T00:44:13,900 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml' 2025-11-27T00:44:13,901 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml' 2025-11-27T00:44:13,902 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml' 2025-11-27T00:44:13,903 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml' 2025-11-27T00:44:13,905 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml' 2025-11-27T00:44:13,906 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml' 2025-11-27T00:44:13,907 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml' 2025-11-27T00:44:13,908 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml' 2025-11-27T00:44:13,909 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml' 2025-11-27T00:44:13,910 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml' 2025-11-27T00:44:13,911 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml' 2025-11-27T00:44:13,912 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml' 2025-11-27T00:44:13,914 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml' 2025-11-27T00:44:13,915 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml' 2025-11-27T00:44:13,916 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml' 2025-11-27T00:44:13,917 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml' 2025-11-27T00:44:13,918 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml' 2025-11-27T00:44:13,919 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml' 2025-11-27T00:44:13,921 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml' 2025-11-27T00:44:13,922 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml' 2025-11-27T00:44:13,923 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml' 2025-11-27T00:44:13,924 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml' 2025-11-27T00:44:13,925 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml' 2025-11-27T00:44:13,926 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml' 2025-11-27T00:44:13,928 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml' 2025-11-27T00:44:13,929 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml' 2025-11-27T00:44:13,930 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml' 2025-11-27T00:44:13,932 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml' 2025-11-27T00:44:13,933 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml' 2025-11-27T00:44:13,934 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml' 2025-11-27T00:44:13,935 adding 'lm_eval/tasks/global_mmlu/full/nl/utils.py' 2025-11-27T00:44:13,938 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml' 2025-11-27T00:44:13,940 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml' 2025-11-27T00:44:13,941 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml' 2025-11-27T00:44:13,942 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml' 2025-11-27T00:44:13,943 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml' 2025-11-27T00:44:13,944 adding 'lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml' 2025-11-27T00:44:13,945 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml' 2025-11-27T00:44:13,946 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml' 2025-11-27T00:44:13,947 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml' 2025-11-27T00:44:13,949 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml' 2025-11-27T00:44:13,950 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml' 2025-11-27T00:44:13,951 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml' 2025-11-27T00:44:13,952 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml' 2025-11-27T00:44:13,953 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml' 2025-11-27T00:44:13,954 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml' 2025-11-27T00:44:13,955 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml' 2025-11-27T00:44:13,956 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml' 2025-11-27T00:44:13,958 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml' 2025-11-27T00:44:13,959 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml' 2025-11-27T00:44:13,960 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml' 2025-11-27T00:44:13,961 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml' 2025-11-27T00:44:13,962 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml' 2025-11-27T00:44:13,963 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml' 2025-11-27T00:44:13,965 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml' 2025-11-27T00:44:13,966 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml' 2025-11-27T00:44:13,967 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml' 2025-11-27T00:44:13,968 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml' 2025-11-27T00:44:13,969 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml' 2025-11-27T00:44:13,970 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml' 2025-11-27T00:44:13,971 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml' 2025-11-27T00:44:13,973 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml' 2025-11-27T00:44:13,974 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml' 2025-11-27T00:44:13,975 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml' 2025-11-27T00:44:13,976 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml' 2025-11-27T00:44:13,977 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml' 2025-11-27T00:44:13,979 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml' 2025-11-27T00:44:13,980 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml' 2025-11-27T00:44:13,981 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml' 2025-11-27T00:44:13,982 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml' 2025-11-27T00:44:13,983 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml' 2025-11-27T00:44:13,984 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml' 2025-11-27T00:44:13,985 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml' 2025-11-27T00:44:13,986 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml' 2025-11-27T00:44:13,987 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml' 2025-11-27T00:44:13,988 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml' 2025-11-27T00:44:13,989 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml' 2025-11-27T00:44:13,990 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml' 2025-11-27T00:44:13,992 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml' 2025-11-27T00:44:13,993 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml' 2025-11-27T00:44:13,994 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml' 2025-11-27T00:44:13,995 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml' 2025-11-27T00:44:13,996 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml' 2025-11-27T00:44:13,997 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml' 2025-11-27T00:44:13,998 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml' 2025-11-27T00:44:13,999 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml' 2025-11-27T00:44:14,001 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml' 2025-11-27T00:44:14,002 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml' 2025-11-27T00:44:14,003 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml' 2025-11-27T00:44:14,004 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml' 2025-11-27T00:44:14,005 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml' 2025-11-27T00:44:14,007 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml' 2025-11-27T00:44:14,008 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml' 2025-11-27T00:44:14,009 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml' 2025-11-27T00:44:14,010 adding 'lm_eval/tasks/global_mmlu/full/ny/utils.py' 2025-11-27T00:44:14,013 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml' 2025-11-27T00:44:14,014 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml' 2025-11-27T00:44:14,015 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml' 2025-11-27T00:44:14,017 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml' 2025-11-27T00:44:14,018 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml' 2025-11-27T00:44:14,019 adding 'lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml' 2025-11-27T00:44:14,020 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml' 2025-11-27T00:44:14,021 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml' 2025-11-27T00:44:14,022 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml' 2025-11-27T00:44:14,024 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml' 2025-11-27T00:44:14,025 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml' 2025-11-27T00:44:14,026 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml' 2025-11-27T00:44:14,027 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml' 2025-11-27T00:44:14,028 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml' 2025-11-27T00:44:14,029 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml' 2025-11-27T00:44:14,030 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml' 2025-11-27T00:44:14,032 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml' 2025-11-27T00:44:14,033 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml' 2025-11-27T00:44:14,034 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml' 2025-11-27T00:44:14,035 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml' 2025-11-27T00:44:14,036 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml' 2025-11-27T00:44:14,037 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml' 2025-11-27T00:44:14,038 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml' 2025-11-27T00:44:14,039 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml' 2025-11-27T00:44:14,040 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml' 2025-11-27T00:44:14,042 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml' 2025-11-27T00:44:14,043 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml' 2025-11-27T00:44:14,044 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml' 2025-11-27T00:44:14,045 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml' 2025-11-27T00:44:14,046 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,047 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,048 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml' 2025-11-27T00:44:14,049 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml' 2025-11-27T00:44:14,051 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml' 2025-11-27T00:44:14,052 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml' 2025-11-27T00:44:14,053 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml' 2025-11-27T00:44:14,054 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml' 2025-11-27T00:44:14,055 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml' 2025-11-27T00:44:14,056 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml' 2025-11-27T00:44:14,057 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml' 2025-11-27T00:44:14,059 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml' 2025-11-27T00:44:14,060 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml' 2025-11-27T00:44:14,061 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml' 2025-11-27T00:44:14,062 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml' 2025-11-27T00:44:14,063 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml' 2025-11-27T00:44:14,064 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml' 2025-11-27T00:44:14,066 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml' 2025-11-27T00:44:14,067 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml' 2025-11-27T00:44:14,068 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml' 2025-11-27T00:44:14,069 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml' 2025-11-27T00:44:14,070 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml' 2025-11-27T00:44:14,071 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml' 2025-11-27T00:44:14,072 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml' 2025-11-27T00:44:14,074 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml' 2025-11-27T00:44:14,075 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml' 2025-11-27T00:44:14,076 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml' 2025-11-27T00:44:14,077 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml' 2025-11-27T00:44:14,078 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml' 2025-11-27T00:44:14,079 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml' 2025-11-27T00:44:14,080 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml' 2025-11-27T00:44:14,081 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml' 2025-11-27T00:44:14,082 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml' 2025-11-27T00:44:14,083 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml' 2025-11-27T00:44:14,085 adding 'lm_eval/tasks/global_mmlu/full/pl/utils.py' 2025-11-27T00:44:14,088 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml' 2025-11-27T00:44:14,089 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml' 2025-11-27T00:44:14,090 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml' 2025-11-27T00:44:14,091 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml' 2025-11-27T00:44:14,092 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml' 2025-11-27T00:44:14,093 adding 'lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml' 2025-11-27T00:44:14,095 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml' 2025-11-27T00:44:14,096 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml' 2025-11-27T00:44:14,097 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml' 2025-11-27T00:44:14,098 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml' 2025-11-27T00:44:14,099 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml' 2025-11-27T00:44:14,100 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml' 2025-11-27T00:44:14,102 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml' 2025-11-27T00:44:14,103 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml' 2025-11-27T00:44:14,104 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml' 2025-11-27T00:44:14,105 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml' 2025-11-27T00:44:14,106 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml' 2025-11-27T00:44:14,107 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml' 2025-11-27T00:44:14,108 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml' 2025-11-27T00:44:14,110 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml' 2025-11-27T00:44:14,111 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml' 2025-11-27T00:44:14,112 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml' 2025-11-27T00:44:14,113 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml' 2025-11-27T00:44:14,114 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml' 2025-11-27T00:44:14,115 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml' 2025-11-27T00:44:14,116 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml' 2025-11-27T00:44:14,117 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml' 2025-11-27T00:44:14,118 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml' 2025-11-27T00:44:14,119 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml' 2025-11-27T00:44:14,120 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,122 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,123 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml' 2025-11-27T00:44:14,124 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml' 2025-11-27T00:44:14,125 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml' 2025-11-27T00:44:14,126 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml' 2025-11-27T00:44:14,127 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml' 2025-11-27T00:44:14,128 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml' 2025-11-27T00:44:14,129 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml' 2025-11-27T00:44:14,130 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml' 2025-11-27T00:44:14,132 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml' 2025-11-27T00:44:14,133 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml' 2025-11-27T00:44:14,134 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml' 2025-11-27T00:44:14,135 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml' 2025-11-27T00:44:14,136 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml' 2025-11-27T00:44:14,137 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml' 2025-11-27T00:44:14,139 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml' 2025-11-27T00:44:14,140 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml' 2025-11-27T00:44:14,141 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml' 2025-11-27T00:44:14,142 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml' 2025-11-27T00:44:14,143 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml' 2025-11-27T00:44:14,144 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml' 2025-11-27T00:44:14,146 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml' 2025-11-27T00:44:14,147 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml' 2025-11-27T00:44:14,148 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml' 2025-11-27T00:44:14,149 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml' 2025-11-27T00:44:14,150 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml' 2025-11-27T00:44:14,151 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml' 2025-11-27T00:44:14,153 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml' 2025-11-27T00:44:14,154 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml' 2025-11-27T00:44:14,155 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml' 2025-11-27T00:44:14,156 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml' 2025-11-27T00:44:14,157 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml' 2025-11-27T00:44:14,158 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml' 2025-11-27T00:44:14,159 adding 'lm_eval/tasks/global_mmlu/full/pt/utils.py' 2025-11-27T00:44:14,162 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml' 2025-11-27T00:44:14,163 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml' 2025-11-27T00:44:14,164 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml' 2025-11-27T00:44:14,165 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml' 2025-11-27T00:44:14,166 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml' 2025-11-27T00:44:14,167 adding 'lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml' 2025-11-27T00:44:14,169 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml' 2025-11-27T00:44:14,170 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml' 2025-11-27T00:44:14,171 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml' 2025-11-27T00:44:14,172 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml' 2025-11-27T00:44:14,173 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml' 2025-11-27T00:44:14,174 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml' 2025-11-27T00:44:14,175 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml' 2025-11-27T00:44:14,176 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml' 2025-11-27T00:44:14,178 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml' 2025-11-27T00:44:14,179 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml' 2025-11-27T00:44:14,180 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml' 2025-11-27T00:44:14,181 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml' 2025-11-27T00:44:14,182 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml' 2025-11-27T00:44:14,184 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml' 2025-11-27T00:44:14,185 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml' 2025-11-27T00:44:14,186 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml' 2025-11-27T00:44:14,187 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml' 2025-11-27T00:44:14,188 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml' 2025-11-27T00:44:14,190 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml' 2025-11-27T00:44:14,191 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml' 2025-11-27T00:44:14,192 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml' 2025-11-27T00:44:14,193 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml' 2025-11-27T00:44:14,194 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml' 2025-11-27T00:44:14,196 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,197 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,198 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml' 2025-11-27T00:44:14,199 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml' 2025-11-27T00:44:14,201 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml' 2025-11-27T00:44:14,202 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml' 2025-11-27T00:44:14,203 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml' 2025-11-27T00:44:14,204 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml' 2025-11-27T00:44:14,205 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml' 2025-11-27T00:44:14,206 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml' 2025-11-27T00:44:14,207 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml' 2025-11-27T00:44:14,208 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml' 2025-11-27T00:44:14,209 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml' 2025-11-27T00:44:14,210 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml' 2025-11-27T00:44:14,212 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml' 2025-11-27T00:44:14,213 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml' 2025-11-27T00:44:14,214 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml' 2025-11-27T00:44:14,215 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml' 2025-11-27T00:44:14,216 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml' 2025-11-27T00:44:14,217 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml' 2025-11-27T00:44:14,218 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml' 2025-11-27T00:44:14,219 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml' 2025-11-27T00:44:14,220 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml' 2025-11-27T00:44:14,222 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml' 2025-11-27T00:44:14,223 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml' 2025-11-27T00:44:14,224 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml' 2025-11-27T00:44:14,225 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml' 2025-11-27T00:44:14,226 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml' 2025-11-27T00:44:14,227 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml' 2025-11-27T00:44:14,228 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml' 2025-11-27T00:44:14,230 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml' 2025-11-27T00:44:14,231 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml' 2025-11-27T00:44:14,232 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml' 2025-11-27T00:44:14,233 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml' 2025-11-27T00:44:14,234 adding 'lm_eval/tasks/global_mmlu/full/ro/utils.py' 2025-11-27T00:44:14,237 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml' 2025-11-27T00:44:14,238 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml' 2025-11-27T00:44:14,239 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml' 2025-11-27T00:44:14,241 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml' 2025-11-27T00:44:14,242 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml' 2025-11-27T00:44:14,243 adding 'lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml' 2025-11-27T00:44:14,244 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml' 2025-11-27T00:44:14,245 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml' 2025-11-27T00:44:14,246 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml' 2025-11-27T00:44:14,247 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml' 2025-11-27T00:44:14,248 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml' 2025-11-27T00:44:14,249 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml' 2025-11-27T00:44:14,250 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml' 2025-11-27T00:44:14,251 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml' 2025-11-27T00:44:14,252 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml' 2025-11-27T00:44:14,254 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml' 2025-11-27T00:44:14,255 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml' 2025-11-27T00:44:14,256 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml' 2025-11-27T00:44:14,257 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml' 2025-11-27T00:44:14,258 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml' 2025-11-27T00:44:14,259 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml' 2025-11-27T00:44:14,260 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml' 2025-11-27T00:44:14,261 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml' 2025-11-27T00:44:14,262 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml' 2025-11-27T00:44:14,264 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml' 2025-11-27T00:44:14,265 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml' 2025-11-27T00:44:14,266 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml' 2025-11-27T00:44:14,267 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml' 2025-11-27T00:44:14,268 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml' 2025-11-27T00:44:14,269 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,270 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,272 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml' 2025-11-27T00:44:14,273 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml' 2025-11-27T00:44:14,274 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml' 2025-11-27T00:44:14,275 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml' 2025-11-27T00:44:14,276 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml' 2025-11-27T00:44:14,278 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml' 2025-11-27T00:44:14,279 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml' 2025-11-27T00:44:14,280 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml' 2025-11-27T00:44:14,281 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml' 2025-11-27T00:44:14,282 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml' 2025-11-27T00:44:14,283 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml' 2025-11-27T00:44:14,284 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml' 2025-11-27T00:44:14,286 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml' 2025-11-27T00:44:14,287 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml' 2025-11-27T00:44:14,288 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml' 2025-11-27T00:44:14,289 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml' 2025-11-27T00:44:14,290 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml' 2025-11-27T00:44:14,291 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml' 2025-11-27T00:44:14,292 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml' 2025-11-27T00:44:14,293 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml' 2025-11-27T00:44:14,294 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml' 2025-11-27T00:44:14,295 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml' 2025-11-27T00:44:14,296 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml' 2025-11-27T00:44:14,298 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml' 2025-11-27T00:44:14,299 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml' 2025-11-27T00:44:14,300 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml' 2025-11-27T00:44:14,301 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml' 2025-11-27T00:44:14,302 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml' 2025-11-27T00:44:14,303 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml' 2025-11-27T00:44:14,304 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml' 2025-11-27T00:44:14,305 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml' 2025-11-27T00:44:14,307 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml' 2025-11-27T00:44:14,308 adding 'lm_eval/tasks/global_mmlu/full/ru/utils.py' 2025-11-27T00:44:14,311 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml' 2025-11-27T00:44:14,312 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml' 2025-11-27T00:44:14,313 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml' 2025-11-27T00:44:14,314 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml' 2025-11-27T00:44:14,315 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml' 2025-11-27T00:44:14,317 adding 'lm_eval/tasks/global_mmlu/full/si/_si_template_yaml' 2025-11-27T00:44:14,318 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml' 2025-11-27T00:44:14,319 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml' 2025-11-27T00:44:14,320 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml' 2025-11-27T00:44:14,321 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml' 2025-11-27T00:44:14,323 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml' 2025-11-27T00:44:14,324 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml' 2025-11-27T00:44:14,325 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml' 2025-11-27T00:44:14,326 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml' 2025-11-27T00:44:14,327 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml' 2025-11-27T00:44:14,329 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml' 2025-11-27T00:44:14,330 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml' 2025-11-27T00:44:14,331 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml' 2025-11-27T00:44:14,332 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml' 2025-11-27T00:44:14,333 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml' 2025-11-27T00:44:14,334 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml' 2025-11-27T00:44:14,335 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml' 2025-11-27T00:44:14,336 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml' 2025-11-27T00:44:14,337 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml' 2025-11-27T00:44:14,338 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml' 2025-11-27T00:44:14,339 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml' 2025-11-27T00:44:14,340 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml' 2025-11-27T00:44:14,341 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml' 2025-11-27T00:44:14,342 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml' 2025-11-27T00:44:14,344 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,345 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,346 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml' 2025-11-27T00:44:14,347 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml' 2025-11-27T00:44:14,348 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml' 2025-11-27T00:44:14,349 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml' 2025-11-27T00:44:14,350 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml' 2025-11-27T00:44:14,352 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml' 2025-11-27T00:44:14,353 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml' 2025-11-27T00:44:14,354 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml' 2025-11-27T00:44:14,355 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml' 2025-11-27T00:44:14,356 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml' 2025-11-27T00:44:14,357 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml' 2025-11-27T00:44:14,358 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml' 2025-11-27T00:44:14,360 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml' 2025-11-27T00:44:14,361 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml' 2025-11-27T00:44:14,362 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml' 2025-11-27T00:44:14,363 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml' 2025-11-27T00:44:14,364 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml' 2025-11-27T00:44:14,365 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml' 2025-11-27T00:44:14,367 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml' 2025-11-27T00:44:14,368 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml' 2025-11-27T00:44:14,369 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml' 2025-11-27T00:44:14,370 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml' 2025-11-27T00:44:14,371 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml' 2025-11-27T00:44:14,372 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml' 2025-11-27T00:44:14,373 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml' 2025-11-27T00:44:14,374 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml' 2025-11-27T00:44:14,375 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml' 2025-11-27T00:44:14,376 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml' 2025-11-27T00:44:14,378 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml' 2025-11-27T00:44:14,379 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml' 2025-11-27T00:44:14,380 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml' 2025-11-27T00:44:14,381 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml' 2025-11-27T00:44:14,382 adding 'lm_eval/tasks/global_mmlu/full/si/utils.py' 2025-11-27T00:44:14,385 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml' 2025-11-27T00:44:14,386 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml' 2025-11-27T00:44:14,387 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml' 2025-11-27T00:44:14,388 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml' 2025-11-27T00:44:14,389 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml' 2025-11-27T00:44:14,391 adding 'lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml' 2025-11-27T00:44:14,392 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml' 2025-11-27T00:44:14,393 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml' 2025-11-27T00:44:14,394 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml' 2025-11-27T00:44:14,395 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml' 2025-11-27T00:44:14,396 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml' 2025-11-27T00:44:14,397 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml' 2025-11-27T00:44:14,398 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml' 2025-11-27T00:44:14,400 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml' 2025-11-27T00:44:14,401 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml' 2025-11-27T00:44:14,402 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml' 2025-11-27T00:44:14,403 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml' 2025-11-27T00:44:14,404 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml' 2025-11-27T00:44:14,406 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml' 2025-11-27T00:44:14,407 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml' 2025-11-27T00:44:14,408 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml' 2025-11-27T00:44:14,409 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml' 2025-11-27T00:44:14,410 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml' 2025-11-27T00:44:14,411 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml' 2025-11-27T00:44:14,413 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml' 2025-11-27T00:44:14,414 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml' 2025-11-27T00:44:14,415 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml' 2025-11-27T00:44:14,416 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml' 2025-11-27T00:44:14,417 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml' 2025-11-27T00:44:14,419 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,420 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,421 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml' 2025-11-27T00:44:14,422 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml' 2025-11-27T00:44:14,423 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml' 2025-11-27T00:44:14,425 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml' 2025-11-27T00:44:14,426 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml' 2025-11-27T00:44:14,427 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml' 2025-11-27T00:44:14,428 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml' 2025-11-27T00:44:14,429 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml' 2025-11-27T00:44:14,431 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml' 2025-11-27T00:44:14,432 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml' 2025-11-27T00:44:14,433 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml' 2025-11-27T00:44:14,434 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml' 2025-11-27T00:44:14,435 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml' 2025-11-27T00:44:14,437 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml' 2025-11-27T00:44:14,438 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml' 2025-11-27T00:44:14,439 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml' 2025-11-27T00:44:14,440 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml' 2025-11-27T00:44:14,442 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml' 2025-11-27T00:44:14,443 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml' 2025-11-27T00:44:14,444 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml' 2025-11-27T00:44:14,445 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml' 2025-11-27T00:44:14,446 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml' 2025-11-27T00:44:14,447 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml' 2025-11-27T00:44:14,449 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml' 2025-11-27T00:44:14,450 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml' 2025-11-27T00:44:14,451 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml' 2025-11-27T00:44:14,452 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml' 2025-11-27T00:44:14,453 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml' 2025-11-27T00:44:14,454 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml' 2025-11-27T00:44:14,455 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml' 2025-11-27T00:44:14,457 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml' 2025-11-27T00:44:14,458 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml' 2025-11-27T00:44:14,459 adding 'lm_eval/tasks/global_mmlu/full/sn/utils.py' 2025-11-27T00:44:14,462 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml' 2025-11-27T00:44:14,463 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml' 2025-11-27T00:44:14,464 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml' 2025-11-27T00:44:14,465 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml' 2025-11-27T00:44:14,466 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml' 2025-11-27T00:44:14,467 adding 'lm_eval/tasks/global_mmlu/full/so/_so_template_yaml' 2025-11-27T00:44:14,468 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml' 2025-11-27T00:44:14,469 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml' 2025-11-27T00:44:14,470 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml' 2025-11-27T00:44:14,471 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml' 2025-11-27T00:44:14,472 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml' 2025-11-27T00:44:14,474 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml' 2025-11-27T00:44:14,475 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml' 2025-11-27T00:44:14,476 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml' 2025-11-27T00:44:14,477 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml' 2025-11-27T00:44:14,478 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml' 2025-11-27T00:44:14,479 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml' 2025-11-27T00:44:14,480 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml' 2025-11-27T00:44:14,481 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml' 2025-11-27T00:44:14,483 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml' 2025-11-27T00:44:14,484 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml' 2025-11-27T00:44:14,485 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml' 2025-11-27T00:44:14,486 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml' 2025-11-27T00:44:14,487 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml' 2025-11-27T00:44:14,488 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml' 2025-11-27T00:44:14,490 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml' 2025-11-27T00:44:14,491 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml' 2025-11-27T00:44:14,492 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml' 2025-11-27T00:44:14,493 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml' 2025-11-27T00:44:14,494 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,495 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,496 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml' 2025-11-27T00:44:14,497 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml' 2025-11-27T00:44:14,499 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml' 2025-11-27T00:44:14,500 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml' 2025-11-27T00:44:14,501 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml' 2025-11-27T00:44:14,502 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml' 2025-11-27T00:44:14,503 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml' 2025-11-27T00:44:14,504 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml' 2025-11-27T00:44:14,505 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml' 2025-11-27T00:44:14,506 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml' 2025-11-27T00:44:14,508 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml' 2025-11-27T00:44:14,509 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml' 2025-11-27T00:44:14,510 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml' 2025-11-27T00:44:14,511 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml' 2025-11-27T00:44:14,512 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml' 2025-11-27T00:44:14,514 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml' 2025-11-27T00:44:14,515 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml' 2025-11-27T00:44:14,516 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml' 2025-11-27T00:44:14,517 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml' 2025-11-27T00:44:14,518 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml' 2025-11-27T00:44:14,519 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml' 2025-11-27T00:44:14,520 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml' 2025-11-27T00:44:14,521 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml' 2025-11-27T00:44:14,523 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml' 2025-11-27T00:44:14,524 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml' 2025-11-27T00:44:14,525 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml' 2025-11-27T00:44:14,526 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml' 2025-11-27T00:44:14,527 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml' 2025-11-27T00:44:14,528 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml' 2025-11-27T00:44:14,530 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml' 2025-11-27T00:44:14,531 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml' 2025-11-27T00:44:14,532 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml' 2025-11-27T00:44:14,533 adding 'lm_eval/tasks/global_mmlu/full/so/utils.py' 2025-11-27T00:44:14,536 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml' 2025-11-27T00:44:14,537 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml' 2025-11-27T00:44:14,539 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml' 2025-11-27T00:44:14,540 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml' 2025-11-27T00:44:14,541 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml' 2025-11-27T00:44:14,542 adding 'lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml' 2025-11-27T00:44:14,543 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml' 2025-11-27T00:44:14,544 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml' 2025-11-27T00:44:14,546 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml' 2025-11-27T00:44:14,547 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml' 2025-11-27T00:44:14,548 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml' 2025-11-27T00:44:14,549 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml' 2025-11-27T00:44:14,550 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml' 2025-11-27T00:44:14,551 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml' 2025-11-27T00:44:14,552 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml' 2025-11-27T00:44:14,554 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml' 2025-11-27T00:44:14,555 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml' 2025-11-27T00:44:14,556 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml' 2025-11-27T00:44:14,557 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml' 2025-11-27T00:44:14,558 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml' 2025-11-27T00:44:14,559 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml' 2025-11-27T00:44:14,560 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml' 2025-11-27T00:44:14,562 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml' 2025-11-27T00:44:14,563 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml' 2025-11-27T00:44:14,564 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml' 2025-11-27T00:44:14,565 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml' 2025-11-27T00:44:14,566 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml' 2025-11-27T00:44:14,567 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml' 2025-11-27T00:44:14,568 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml' 2025-11-27T00:44:14,569 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,570 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,572 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml' 2025-11-27T00:44:14,573 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml' 2025-11-27T00:44:14,574 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml' 2025-11-27T00:44:14,575 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml' 2025-11-27T00:44:14,576 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml' 2025-11-27T00:44:14,577 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml' 2025-11-27T00:44:14,578 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml' 2025-11-27T00:44:14,580 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml' 2025-11-27T00:44:14,581 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml' 2025-11-27T00:44:14,582 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml' 2025-11-27T00:44:14,583 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml' 2025-11-27T00:44:14,584 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml' 2025-11-27T00:44:14,585 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml' 2025-11-27T00:44:14,587 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml' 2025-11-27T00:44:14,588 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml' 2025-11-27T00:44:14,589 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml' 2025-11-27T00:44:14,590 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml' 2025-11-27T00:44:14,591 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml' 2025-11-27T00:44:14,592 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml' 2025-11-27T00:44:14,593 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml' 2025-11-27T00:44:14,594 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml' 2025-11-27T00:44:14,595 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml' 2025-11-27T00:44:14,596 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml' 2025-11-27T00:44:14,597 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml' 2025-11-27T00:44:14,598 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml' 2025-11-27T00:44:14,600 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml' 2025-11-27T00:44:14,601 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml' 2025-11-27T00:44:14,602 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml' 2025-11-27T00:44:14,603 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml' 2025-11-27T00:44:14,604 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml' 2025-11-27T00:44:14,605 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml' 2025-11-27T00:44:14,606 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml' 2025-11-27T00:44:14,608 adding 'lm_eval/tasks/global_mmlu/full/sr/utils.py' 2025-11-27T00:44:14,611 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml' 2025-11-27T00:44:14,612 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml' 2025-11-27T00:44:14,613 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml' 2025-11-27T00:44:14,614 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml' 2025-11-27T00:44:14,615 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml' 2025-11-27T00:44:14,616 adding 'lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml' 2025-11-27T00:44:14,618 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml' 2025-11-27T00:44:14,619 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml' 2025-11-27T00:44:14,620 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml' 2025-11-27T00:44:14,621 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml' 2025-11-27T00:44:14,622 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml' 2025-11-27T00:44:14,623 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml' 2025-11-27T00:44:14,624 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml' 2025-11-27T00:44:14,626 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml' 2025-11-27T00:44:14,627 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml' 2025-11-27T00:44:14,628 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml' 2025-11-27T00:44:14,629 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml' 2025-11-27T00:44:14,630 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml' 2025-11-27T00:44:14,631 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml' 2025-11-27T00:44:14,633 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml' 2025-11-27T00:44:14,634 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml' 2025-11-27T00:44:14,635 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml' 2025-11-27T00:44:14,636 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml' 2025-11-27T00:44:14,637 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml' 2025-11-27T00:44:14,638 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml' 2025-11-27T00:44:14,639 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml' 2025-11-27T00:44:14,640 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml' 2025-11-27T00:44:14,641 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml' 2025-11-27T00:44:14,643 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml' 2025-11-27T00:44:14,644 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,645 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,646 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml' 2025-11-27T00:44:14,647 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml' 2025-11-27T00:44:14,648 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml' 2025-11-27T00:44:14,649 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml' 2025-11-27T00:44:14,650 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml' 2025-11-27T00:44:14,652 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml' 2025-11-27T00:44:14,653 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml' 2025-11-27T00:44:14,654 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml' 2025-11-27T00:44:14,655 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml' 2025-11-27T00:44:14,656 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml' 2025-11-27T00:44:14,657 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml' 2025-11-27T00:44:14,658 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml' 2025-11-27T00:44:14,660 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml' 2025-11-27T00:44:14,661 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml' 2025-11-27T00:44:14,662 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml' 2025-11-27T00:44:14,663 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml' 2025-11-27T00:44:14,665 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml' 2025-11-27T00:44:14,666 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml' 2025-11-27T00:44:14,667 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml' 2025-11-27T00:44:14,668 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml' 2025-11-27T00:44:14,670 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml' 2025-11-27T00:44:14,671 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml' 2025-11-27T00:44:14,672 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml' 2025-11-27T00:44:14,673 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml' 2025-11-27T00:44:14,674 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml' 2025-11-27T00:44:14,676 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml' 2025-11-27T00:44:14,677 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml' 2025-11-27T00:44:14,678 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml' 2025-11-27T00:44:14,679 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml' 2025-11-27T00:44:14,680 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml' 2025-11-27T00:44:14,681 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml' 2025-11-27T00:44:14,682 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml' 2025-11-27T00:44:14,683 adding 'lm_eval/tasks/global_mmlu/full/sv/utils.py' 2025-11-27T00:44:14,686 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml' 2025-11-27T00:44:14,688 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml' 2025-11-27T00:44:14,689 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml' 2025-11-27T00:44:14,690 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml' 2025-11-27T00:44:14,691 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml' 2025-11-27T00:44:14,692 adding 'lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml' 2025-11-27T00:44:14,693 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml' 2025-11-27T00:44:14,695 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml' 2025-11-27T00:44:14,696 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml' 2025-11-27T00:44:14,697 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml' 2025-11-27T00:44:14,698 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml' 2025-11-27T00:44:14,699 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml' 2025-11-27T00:44:14,700 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml' 2025-11-27T00:44:14,701 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml' 2025-11-27T00:44:14,703 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml' 2025-11-27T00:44:14,704 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml' 2025-11-27T00:44:14,705 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml' 2025-11-27T00:44:14,706 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml' 2025-11-27T00:44:14,707 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml' 2025-11-27T00:44:14,708 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml' 2025-11-27T00:44:14,709 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml' 2025-11-27T00:44:14,711 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml' 2025-11-27T00:44:14,712 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml' 2025-11-27T00:44:14,713 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml' 2025-11-27T00:44:14,714 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml' 2025-11-27T00:44:14,715 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml' 2025-11-27T00:44:14,716 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml' 2025-11-27T00:44:14,717 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml' 2025-11-27T00:44:14,719 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml' 2025-11-27T00:44:14,720 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,721 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,722 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml' 2025-11-27T00:44:14,723 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml' 2025-11-27T00:44:14,724 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml' 2025-11-27T00:44:14,725 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml' 2025-11-27T00:44:14,726 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml' 2025-11-27T00:44:14,728 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml' 2025-11-27T00:44:14,729 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml' 2025-11-27T00:44:14,730 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml' 2025-11-27T00:44:14,731 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml' 2025-11-27T00:44:14,732 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml' 2025-11-27T00:44:14,734 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml' 2025-11-27T00:44:14,735 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml' 2025-11-27T00:44:14,736 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml' 2025-11-27T00:44:14,737 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml' 2025-11-27T00:44:14,738 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml' 2025-11-27T00:44:14,739 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml' 2025-11-27T00:44:14,740 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml' 2025-11-27T00:44:14,742 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml' 2025-11-27T00:44:14,743 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml' 2025-11-27T00:44:14,744 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml' 2025-11-27T00:44:14,745 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml' 2025-11-27T00:44:14,746 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml' 2025-11-27T00:44:14,747 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml' 2025-11-27T00:44:14,748 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml' 2025-11-27T00:44:14,750 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml' 2025-11-27T00:44:14,751 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml' 2025-11-27T00:44:14,752 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml' 2025-11-27T00:44:14,753 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml' 2025-11-27T00:44:14,754 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml' 2025-11-27T00:44:14,756 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml' 2025-11-27T00:44:14,757 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml' 2025-11-27T00:44:14,758 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml' 2025-11-27T00:44:14,759 adding 'lm_eval/tasks/global_mmlu/full/sw/utils.py' 2025-11-27T00:44:14,763 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml' 2025-11-27T00:44:14,764 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml' 2025-11-27T00:44:14,766 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml' 2025-11-27T00:44:14,768 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml' 2025-11-27T00:44:14,769 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml' 2025-11-27T00:44:14,770 adding 'lm_eval/tasks/global_mmlu/full/te/_te_template_yaml' 2025-11-27T00:44:14,771 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml' 2025-11-27T00:44:14,772 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml' 2025-11-27T00:44:14,773 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml' 2025-11-27T00:44:14,774 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml' 2025-11-27T00:44:14,776 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml' 2025-11-27T00:44:14,777 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml' 2025-11-27T00:44:14,778 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml' 2025-11-27T00:44:14,779 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml' 2025-11-27T00:44:14,781 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml' 2025-11-27T00:44:14,782 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml' 2025-11-27T00:44:14,783 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml' 2025-11-27T00:44:14,784 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml' 2025-11-27T00:44:14,785 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml' 2025-11-27T00:44:14,786 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml' 2025-11-27T00:44:14,787 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml' 2025-11-27T00:44:14,789 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml' 2025-11-27T00:44:14,790 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml' 2025-11-27T00:44:14,791 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml' 2025-11-27T00:44:14,792 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml' 2025-11-27T00:44:14,793 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml' 2025-11-27T00:44:14,794 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml' 2025-11-27T00:44:14,795 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml' 2025-11-27T00:44:14,797 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml' 2025-11-27T00:44:14,798 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,799 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,801 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml' 2025-11-27T00:44:14,802 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml' 2025-11-27T00:44:14,803 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml' 2025-11-27T00:44:14,805 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml' 2025-11-27T00:44:14,806 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml' 2025-11-27T00:44:14,808 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml' 2025-11-27T00:44:14,810 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml' 2025-11-27T00:44:14,811 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml' 2025-11-27T00:44:14,812 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml' 2025-11-27T00:44:14,813 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml' 2025-11-27T00:44:14,814 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml' 2025-11-27T00:44:14,815 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml' 2025-11-27T00:44:14,817 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml' 2025-11-27T00:44:14,818 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml' 2025-11-27T00:44:14,819 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml' 2025-11-27T00:44:14,822 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml' 2025-11-27T00:44:14,823 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml' 2025-11-27T00:44:14,824 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml' 2025-11-27T00:44:14,825 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml' 2025-11-27T00:44:14,826 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml' 2025-11-27T00:44:14,828 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml' 2025-11-27T00:44:14,829 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml' 2025-11-27T00:44:14,830 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml' 2025-11-27T00:44:14,831 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml' 2025-11-27T00:44:14,832 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml' 2025-11-27T00:44:14,833 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml' 2025-11-27T00:44:14,834 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml' 2025-11-27T00:44:14,836 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml' 2025-11-27T00:44:14,837 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml' 2025-11-27T00:44:14,838 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml' 2025-11-27T00:44:14,839 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml' 2025-11-27T00:44:14,841 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml' 2025-11-27T00:44:14,842 adding 'lm_eval/tasks/global_mmlu/full/te/utils.py' 2025-11-27T00:44:14,845 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml' 2025-11-27T00:44:14,847 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml' 2025-11-27T00:44:14,848 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml' 2025-11-27T00:44:14,850 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml' 2025-11-27T00:44:14,851 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml' 2025-11-27T00:44:14,852 adding 'lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml' 2025-11-27T00:44:14,854 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml' 2025-11-27T00:44:14,855 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml' 2025-11-27T00:44:14,857 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml' 2025-11-27T00:44:14,858 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml' 2025-11-27T00:44:14,859 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml' 2025-11-27T00:44:14,860 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml' 2025-11-27T00:44:14,861 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml' 2025-11-27T00:44:14,863 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml' 2025-11-27T00:44:14,864 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml' 2025-11-27T00:44:14,865 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml' 2025-11-27T00:44:14,866 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml' 2025-11-27T00:44:14,867 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml' 2025-11-27T00:44:14,868 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml' 2025-11-27T00:44:14,869 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml' 2025-11-27T00:44:14,870 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml' 2025-11-27T00:44:14,872 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml' 2025-11-27T00:44:14,873 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml' 2025-11-27T00:44:14,874 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml' 2025-11-27T00:44:14,875 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml' 2025-11-27T00:44:14,876 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml' 2025-11-27T00:44:14,877 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml' 2025-11-27T00:44:14,878 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml' 2025-11-27T00:44:14,880 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml' 2025-11-27T00:44:14,881 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,882 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,883 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml' 2025-11-27T00:44:14,884 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml' 2025-11-27T00:44:14,885 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml' 2025-11-27T00:44:14,887 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml' 2025-11-27T00:44:14,888 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml' 2025-11-27T00:44:14,889 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml' 2025-11-27T00:44:14,890 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml' 2025-11-27T00:44:14,891 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml' 2025-11-27T00:44:14,892 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml' 2025-11-27T00:44:14,894 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml' 2025-11-27T00:44:14,895 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml' 2025-11-27T00:44:14,896 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml' 2025-11-27T00:44:14,897 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml' 2025-11-27T00:44:14,898 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml' 2025-11-27T00:44:14,900 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml' 2025-11-27T00:44:14,901 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml' 2025-11-27T00:44:14,902 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml' 2025-11-27T00:44:14,903 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml' 2025-11-27T00:44:14,904 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml' 2025-11-27T00:44:14,905 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml' 2025-11-27T00:44:14,906 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml' 2025-11-27T00:44:14,907 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml' 2025-11-27T00:44:14,908 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml' 2025-11-27T00:44:14,909 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml' 2025-11-27T00:44:14,911 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml' 2025-11-27T00:44:14,912 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml' 2025-11-27T00:44:14,913 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml' 2025-11-27T00:44:14,914 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml' 2025-11-27T00:44:14,915 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml' 2025-11-27T00:44:14,916 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml' 2025-11-27T00:44:14,917 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml' 2025-11-27T00:44:14,918 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml' 2025-11-27T00:44:14,920 adding 'lm_eval/tasks/global_mmlu/full/tr/utils.py' 2025-11-27T00:44:14,923 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml' 2025-11-27T00:44:14,924 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml' 2025-11-27T00:44:14,925 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml' 2025-11-27T00:44:14,926 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml' 2025-11-27T00:44:14,927 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml' 2025-11-27T00:44:14,928 adding 'lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml' 2025-11-27T00:44:14,929 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml' 2025-11-27T00:44:14,931 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml' 2025-11-27T00:44:14,932 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml' 2025-11-27T00:44:14,933 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml' 2025-11-27T00:44:14,934 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml' 2025-11-27T00:44:14,935 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml' 2025-11-27T00:44:14,936 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml' 2025-11-27T00:44:14,937 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml' 2025-11-27T00:44:14,939 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml' 2025-11-27T00:44:14,940 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml' 2025-11-27T00:44:14,941 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml' 2025-11-27T00:44:14,942 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml' 2025-11-27T00:44:14,943 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml' 2025-11-27T00:44:14,944 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml' 2025-11-27T00:44:14,946 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml' 2025-11-27T00:44:14,947 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml' 2025-11-27T00:44:14,948 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml' 2025-11-27T00:44:14,949 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml' 2025-11-27T00:44:14,950 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml' 2025-11-27T00:44:14,951 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml' 2025-11-27T00:44:14,952 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml' 2025-11-27T00:44:14,953 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml' 2025-11-27T00:44:14,954 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml' 2025-11-27T00:44:14,956 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml' 2025-11-27T00:44:14,957 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml' 2025-11-27T00:44:14,958 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml' 2025-11-27T00:44:14,959 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml' 2025-11-27T00:44:14,960 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml' 2025-11-27T00:44:14,961 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml' 2025-11-27T00:44:14,962 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml' 2025-11-27T00:44:14,963 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml' 2025-11-27T00:44:14,964 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml' 2025-11-27T00:44:14,966 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml' 2025-11-27T00:44:14,967 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml' 2025-11-27T00:44:14,968 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml' 2025-11-27T00:44:14,969 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml' 2025-11-27T00:44:14,970 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml' 2025-11-27T00:44:14,971 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml' 2025-11-27T00:44:14,973 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml' 2025-11-27T00:44:14,974 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml' 2025-11-27T00:44:14,975 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml' 2025-11-27T00:44:14,976 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml' 2025-11-27T00:44:14,977 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml' 2025-11-27T00:44:14,978 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml' 2025-11-27T00:44:14,979 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml' 2025-11-27T00:44:14,981 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml' 2025-11-27T00:44:14,982 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml' 2025-11-27T00:44:14,983 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml' 2025-11-27T00:44:14,984 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml' 2025-11-27T00:44:14,985 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml' 2025-11-27T00:44:14,986 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml' 2025-11-27T00:44:14,988 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml' 2025-11-27T00:44:14,989 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml' 2025-11-27T00:44:14,990 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml' 2025-11-27T00:44:14,991 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml' 2025-11-27T00:44:14,992 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml' 2025-11-27T00:44:14,993 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml' 2025-11-27T00:44:14,994 adding 'lm_eval/tasks/global_mmlu/full/uk/utils.py' 2025-11-27T00:44:14,997 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml' 2025-11-27T00:44:14,998 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml' 2025-11-27T00:44:15,000 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml' 2025-11-27T00:44:15,001 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml' 2025-11-27T00:44:15,002 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml' 2025-11-27T00:44:15,003 adding 'lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml' 2025-11-27T00:44:15,004 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml' 2025-11-27T00:44:15,005 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml' 2025-11-27T00:44:15,006 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml' 2025-11-27T00:44:15,007 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml' 2025-11-27T00:44:15,009 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml' 2025-11-27T00:44:15,010 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml' 2025-11-27T00:44:15,011 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml' 2025-11-27T00:44:15,012 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml' 2025-11-27T00:44:15,013 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml' 2025-11-27T00:44:15,014 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml' 2025-11-27T00:44:15,015 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml' 2025-11-27T00:44:15,017 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml' 2025-11-27T00:44:15,018 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml' 2025-11-27T00:44:15,019 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml' 2025-11-27T00:44:15,020 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml' 2025-11-27T00:44:15,021 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml' 2025-11-27T00:44:15,022 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml' 2025-11-27T00:44:15,023 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml' 2025-11-27T00:44:15,025 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml' 2025-11-27T00:44:15,026 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml' 2025-11-27T00:44:15,027 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml' 2025-11-27T00:44:15,028 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml' 2025-11-27T00:44:15,029 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml' 2025-11-27T00:44:15,030 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml' 2025-11-27T00:44:15,031 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml' 2025-11-27T00:44:15,033 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml' 2025-11-27T00:44:15,034 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml' 2025-11-27T00:44:15,035 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml' 2025-11-27T00:44:15,036 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml' 2025-11-27T00:44:15,037 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml' 2025-11-27T00:44:15,038 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml' 2025-11-27T00:44:15,039 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml' 2025-11-27T00:44:15,040 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml' 2025-11-27T00:44:15,042 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml' 2025-11-27T00:44:15,043 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml' 2025-11-27T00:44:15,044 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml' 2025-11-27T00:44:15,045 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml' 2025-11-27T00:44:15,046 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml' 2025-11-27T00:44:15,047 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml' 2025-11-27T00:44:15,048 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml' 2025-11-27T00:44:15,050 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml' 2025-11-27T00:44:15,051 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml' 2025-11-27T00:44:15,052 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml' 2025-11-27T00:44:15,053 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml' 2025-11-27T00:44:15,054 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml' 2025-11-27T00:44:15,055 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml' 2025-11-27T00:44:15,056 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml' 2025-11-27T00:44:15,057 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml' 2025-11-27T00:44:15,059 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml' 2025-11-27T00:44:15,060 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml' 2025-11-27T00:44:15,061 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml' 2025-11-27T00:44:15,062 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml' 2025-11-27T00:44:15,063 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml' 2025-11-27T00:44:15,064 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml' 2025-11-27T00:44:15,065 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml' 2025-11-27T00:44:15,067 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml' 2025-11-27T00:44:15,068 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml' 2025-11-27T00:44:15,069 adding 'lm_eval/tasks/global_mmlu/full/vi/utils.py' 2025-11-27T00:44:15,072 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml' 2025-11-27T00:44:15,074 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml' 2025-11-27T00:44:15,075 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml' 2025-11-27T00:44:15,076 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml' 2025-11-27T00:44:15,077 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml' 2025-11-27T00:44:15,078 adding 'lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml' 2025-11-27T00:44:15,079 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml' 2025-11-27T00:44:15,080 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml' 2025-11-27T00:44:15,082 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml' 2025-11-27T00:44:15,083 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml' 2025-11-27T00:44:15,084 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml' 2025-11-27T00:44:15,085 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml' 2025-11-27T00:44:15,086 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml' 2025-11-27T00:44:15,087 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml' 2025-11-27T00:44:15,088 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml' 2025-11-27T00:44:15,089 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml' 2025-11-27T00:44:15,091 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml' 2025-11-27T00:44:15,092 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml' 2025-11-27T00:44:15,093 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml' 2025-11-27T00:44:15,094 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml' 2025-11-27T00:44:15,095 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml' 2025-11-27T00:44:15,096 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml' 2025-11-27T00:44:15,097 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml' 2025-11-27T00:44:15,098 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml' 2025-11-27T00:44:15,100 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml' 2025-11-27T00:44:15,101 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml' 2025-11-27T00:44:15,102 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml' 2025-11-27T00:44:15,103 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml' 2025-11-27T00:44:15,104 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml' 2025-11-27T00:44:15,105 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml' 2025-11-27T00:44:15,107 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml' 2025-11-27T00:44:15,108 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml' 2025-11-27T00:44:15,109 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml' 2025-11-27T00:44:15,110 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml' 2025-11-27T00:44:15,111 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml' 2025-11-27T00:44:15,112 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml' 2025-11-27T00:44:15,114 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml' 2025-11-27T00:44:15,115 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml' 2025-11-27T00:44:15,116 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml' 2025-11-27T00:44:15,117 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml' 2025-11-27T00:44:15,118 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml' 2025-11-27T00:44:15,119 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml' 2025-11-27T00:44:15,121 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml' 2025-11-27T00:44:15,122 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml' 2025-11-27T00:44:15,123 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml' 2025-11-27T00:44:15,124 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml' 2025-11-27T00:44:15,125 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml' 2025-11-27T00:44:15,126 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml' 2025-11-27T00:44:15,127 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml' 2025-11-27T00:44:15,128 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml' 2025-11-27T00:44:15,129 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml' 2025-11-27T00:44:15,130 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml' 2025-11-27T00:44:15,131 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml' 2025-11-27T00:44:15,133 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml' 2025-11-27T00:44:15,134 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml' 2025-11-27T00:44:15,135 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml' 2025-11-27T00:44:15,136 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml' 2025-11-27T00:44:15,137 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml' 2025-11-27T00:44:15,138 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml' 2025-11-27T00:44:15,139 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml' 2025-11-27T00:44:15,140 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml' 2025-11-27T00:44:15,142 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml' 2025-11-27T00:44:15,143 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml' 2025-11-27T00:44:15,144 adding 'lm_eval/tasks/global_mmlu/full/yo/utils.py' 2025-11-27T00:44:15,147 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml' 2025-11-27T00:44:15,148 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml' 2025-11-27T00:44:15,149 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml' 2025-11-27T00:44:15,150 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml' 2025-11-27T00:44:15,151 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml' 2025-11-27T00:44:15,153 adding 'lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml' 2025-11-27T00:44:15,154 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml' 2025-11-27T00:44:15,155 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml' 2025-11-27T00:44:15,156 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml' 2025-11-27T00:44:15,157 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml' 2025-11-27T00:44:15,158 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml' 2025-11-27T00:44:15,160 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml' 2025-11-27T00:44:15,161 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml' 2025-11-27T00:44:15,162 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml' 2025-11-27T00:44:15,163 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml' 2025-11-27T00:44:15,164 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml' 2025-11-27T00:44:15,165 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml' 2025-11-27T00:44:15,166 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml' 2025-11-27T00:44:15,167 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml' 2025-11-27T00:44:15,169 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml' 2025-11-27T00:44:15,170 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml' 2025-11-27T00:44:15,171 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml' 2025-11-27T00:44:15,172 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml' 2025-11-27T00:44:15,173 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml' 2025-11-27T00:44:15,174 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml' 2025-11-27T00:44:15,175 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml' 2025-11-27T00:44:15,176 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml' 2025-11-27T00:44:15,177 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml' 2025-11-27T00:44:15,178 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml' 2025-11-27T00:44:15,180 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml' 2025-11-27T00:44:15,181 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml' 2025-11-27T00:44:15,182 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml' 2025-11-27T00:44:15,183 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml' 2025-11-27T00:44:15,184 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml' 2025-11-27T00:44:15,185 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml' 2025-11-27T00:44:15,186 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml' 2025-11-27T00:44:15,188 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml' 2025-11-27T00:44:15,189 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml' 2025-11-27T00:44:15,190 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml' 2025-11-27T00:44:15,191 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml' 2025-11-27T00:44:15,192 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml' 2025-11-27T00:44:15,193 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml' 2025-11-27T00:44:15,194 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml' 2025-11-27T00:44:15,195 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml' 2025-11-27T00:44:15,197 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml' 2025-11-27T00:44:15,198 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml' 2025-11-27T00:44:15,199 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml' 2025-11-27T00:44:15,200 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml' 2025-11-27T00:44:15,201 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml' 2025-11-27T00:44:15,202 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml' 2025-11-27T00:44:15,204 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml' 2025-11-27T00:44:15,205 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml' 2025-11-27T00:44:15,206 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml' 2025-11-27T00:44:15,207 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml' 2025-11-27T00:44:15,208 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml' 2025-11-27T00:44:15,209 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml' 2025-11-27T00:44:15,210 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml' 2025-11-27T00:44:15,211 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml' 2025-11-27T00:44:15,212 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml' 2025-11-27T00:44:15,213 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml' 2025-11-27T00:44:15,215 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml' 2025-11-27T00:44:15,216 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml' 2025-11-27T00:44:15,217 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml' 2025-11-27T00:44:15,218 adding 'lm_eval/tasks/global_mmlu/full/zh/utils.py' 2025-11-27T00:44:15,220 adding 'lm_eval/tasks/global_piqa/README.md' 2025-11-27T00:44:15,223 adding 'lm_eval/tasks/global_piqa/completions/_generate_config.py' 2025-11-27T00:44:15,225 adding 'lm_eval/tasks/global_piqa/completions/_global_piqa.yaml' 2025-11-27T00:44:15,226 adding 'lm_eval/tasks/global_piqa/completions/_template' 2025-11-27T00:44:15,227 adding 'lm_eval/tasks/global_piqa/completions/acm_arab.yaml' 2025-11-27T00:44:15,228 adding 'lm_eval/tasks/global_piqa/completions/acq_arab.yaml' 2025-11-27T00:44:15,229 adding 'lm_eval/tasks/global_piqa/completions/aeb_arab.yaml' 2025-11-27T00:44:15,230 adding 'lm_eval/tasks/global_piqa/completions/afb_arab.yaml' 2025-11-27T00:44:15,232 adding 'lm_eval/tasks/global_piqa/completions/als_latn.yaml' 2025-11-27T00:44:15,233 adding 'lm_eval/tasks/global_piqa/completions/amh_ethi.yaml' 2025-11-27T00:44:15,234 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml' 2025-11-27T00:44:15,235 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml' 2025-11-27T00:44:15,236 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml' 2025-11-27T00:44:15,237 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml' 2025-11-27T00:44:15,238 adding 'lm_eval/tasks/global_piqa/completions/arb_arab.yaml' 2025-11-27T00:44:15,240 adding 'lm_eval/tasks/global_piqa/completions/arq_arab.yaml' 2025-11-27T00:44:15,241 adding 'lm_eval/tasks/global_piqa/completions/ars_arab.yaml' 2025-11-27T00:44:15,242 adding 'lm_eval/tasks/global_piqa/completions/ary_arab.yaml' 2025-11-27T00:44:15,243 adding 'lm_eval/tasks/global_piqa/completions/arz_arab.yaml' 2025-11-27T00:44:15,244 adding 'lm_eval/tasks/global_piqa/completions/asm_beng.yaml' 2025-11-27T00:44:15,245 adding 'lm_eval/tasks/global_piqa/completions/azj_latn.yaml' 2025-11-27T00:44:15,246 adding 'lm_eval/tasks/global_piqa/completions/bam_latn.yaml' 2025-11-27T00:44:15,247 adding 'lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml' 2025-11-27T00:44:15,249 adding 'lm_eval/tasks/global_piqa/completions/ben_beng.yaml' 2025-11-27T00:44:15,250 adding 'lm_eval/tasks/global_piqa/completions/ben_latn.yaml' 2025-11-27T00:44:15,251 adding 'lm_eval/tasks/global_piqa/completions/bho_deva.yaml' 2025-11-27T00:44:15,252 adding 'lm_eval/tasks/global_piqa/completions/bos_latn.yaml' 2025-11-27T00:44:15,253 adding 'lm_eval/tasks/global_piqa/completions/bsk_arab.yaml' 2025-11-27T00:44:15,254 adding 'lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml' 2025-11-27T00:44:15,255 adding 'lm_eval/tasks/global_piqa/completions/cat_latn.yaml' 2025-11-27T00:44:15,257 adding 'lm_eval/tasks/global_piqa/completions/ces_latn.yaml' 2025-11-27T00:44:15,258 adding 'lm_eval/tasks/global_piqa/completions/ckb_arab.yaml' 2025-11-27T00:44:15,259 adding 'lm_eval/tasks/global_piqa/completions/ckm_latn.yaml' 2025-11-27T00:44:15,260 adding 'lm_eval/tasks/global_piqa/completions/cmn_hans.yaml' 2025-11-27T00:44:15,261 adding 'lm_eval/tasks/global_piqa/completions/cmn_hant.yaml' 2025-11-27T00:44:15,262 adding 'lm_eval/tasks/global_piqa/completions/deu_latn.yaml' 2025-11-27T00:44:15,263 adding 'lm_eval/tasks/global_piqa/completions/dhd_deva.yaml' 2025-11-27T00:44:15,264 adding 'lm_eval/tasks/global_piqa/completions/ekk_latn.yaml' 2025-11-27T00:44:15,265 adding 'lm_eval/tasks/global_piqa/completions/ekp_latn.yaml' 2025-11-27T00:44:15,266 adding 'lm_eval/tasks/global_piqa/completions/ell_grek.yaml' 2025-11-27T00:44:15,267 adding 'lm_eval/tasks/global_piqa/completions/eng_latn.yaml' 2025-11-27T00:44:15,269 adding 'lm_eval/tasks/global_piqa/completions/fao_latn.yaml' 2025-11-27T00:44:15,270 adding 'lm_eval/tasks/global_piqa/completions/fin_latn.yaml' 2025-11-27T00:44:15,271 adding 'lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml' 2025-11-27T00:44:15,272 adding 'lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml' 2025-11-27T00:44:15,273 adding 'lm_eval/tasks/global_piqa/completions/glg_latn.yaml' 2025-11-27T00:44:15,274 adding 'lm_eval/tasks/global_piqa/completions/guj_gujr.yaml' 2025-11-27T00:44:15,275 adding 'lm_eval/tasks/global_piqa/completions/hau_latn.yaml' 2025-11-27T00:44:15,277 adding 'lm_eval/tasks/global_piqa/completions/haw_latn.yaml' 2025-11-27T00:44:15,278 adding 'lm_eval/tasks/global_piqa/completions/heb_hebr.yaml' 2025-11-27T00:44:15,279 adding 'lm_eval/tasks/global_piqa/completions/hin_deva.yaml' 2025-11-27T00:44:15,280 adding 'lm_eval/tasks/global_piqa/completions/hrv_latn.yaml' 2025-11-27T00:44:15,281 adding 'lm_eval/tasks/global_piqa/completions/hun_latn.yaml' 2025-11-27T00:44:15,282 adding 'lm_eval/tasks/global_piqa/completions/hye_armn.yaml' 2025-11-27T00:44:15,283 adding 'lm_eval/tasks/global_piqa/completions/ibo_latn.yaml' 2025-11-27T00:44:15,284 adding 'lm_eval/tasks/global_piqa/completions/idu_latn.yaml' 2025-11-27T00:44:15,286 adding 'lm_eval/tasks/global_piqa/completions/ind_latn.yaml' 2025-11-27T00:44:15,287 adding 'lm_eval/tasks/global_piqa/completions/isl_latn.yaml' 2025-11-27T00:44:15,288 adding 'lm_eval/tasks/global_piqa/completions/iso_latn.yaml' 2025-11-27T00:44:15,289 adding 'lm_eval/tasks/global_piqa/completions/ita_latn.yaml' 2025-11-27T00:44:15,290 adding 'lm_eval/tasks/global_piqa/completions/jav_latn.yaml' 2025-11-27T00:44:15,291 adding 'lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml' 2025-11-27T00:44:15,292 adding 'lm_eval/tasks/global_piqa/completions/kan_knda.yaml' 2025-11-27T00:44:15,293 adding 'lm_eval/tasks/global_piqa/completions/kat_geor.yaml' 2025-11-27T00:44:15,295 adding 'lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml' 2025-11-27T00:44:15,296 adding 'lm_eval/tasks/global_piqa/completions/kin_latn.yaml' 2025-11-27T00:44:15,297 adding 'lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml' 2025-11-27T00:44:15,298 adding 'lm_eval/tasks/global_piqa/completions/kor_hang.yaml' 2025-11-27T00:44:15,299 adding 'lm_eval/tasks/global_piqa/completions/lin_latn.yaml' 2025-11-27T00:44:15,300 adding 'lm_eval/tasks/global_piqa/completions/lit_latn.yaml' 2025-11-27T00:44:15,301 adding 'lm_eval/tasks/global_piqa/completions/luo_latn.yaml' 2025-11-27T00:44:15,303 adding 'lm_eval/tasks/global_piqa/completions/mal_mlym.yaml' 2025-11-27T00:44:15,304 adding 'lm_eval/tasks/global_piqa/completions/mar_deva.yaml' 2025-11-27T00:44:15,305 adding 'lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml' 2025-11-27T00:44:15,306 adding 'lm_eval/tasks/global_piqa/completions/mni_beng.yaml' 2025-11-27T00:44:15,307 adding 'lm_eval/tasks/global_piqa/completions/mni_mtei.yaml' 2025-11-27T00:44:15,308 adding 'lm_eval/tasks/global_piqa/completions/nag_latn.yaml' 2025-11-27T00:44:15,310 adding 'lm_eval/tasks/global_piqa/completions/nld_latn.yaml' 2025-11-27T00:44:15,311 adding 'lm_eval/tasks/global_piqa/completions/nno_latn.yaml' 2025-11-27T00:44:15,312 adding 'lm_eval/tasks/global_piqa/completions/nob_latn.yaml' 2025-11-27T00:44:15,313 adding 'lm_eval/tasks/global_piqa/completions/npi_deva.yaml' 2025-11-27T00:44:15,314 adding 'lm_eval/tasks/global_piqa/completions/pan_guru.yaml' 2025-11-27T00:44:15,315 adding 'lm_eval/tasks/global_piqa/completions/pcm_latn.yaml' 2025-11-27T00:44:15,316 adding 'lm_eval/tasks/global_piqa/completions/pes_arab.yaml' 2025-11-27T00:44:15,317 adding 'lm_eval/tasks/global_piqa/completions/pol_latn.yaml' 2025-11-27T00:44:15,318 adding 'lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml' 2025-11-27T00:44:15,319 adding 'lm_eval/tasks/global_piqa/completions/por_latn_port.yaml' 2025-11-27T00:44:15,320 adding 'lm_eval/tasks/global_piqa/completions/ron_latn.yaml' 2025-11-27T00:44:15,321 adding 'lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml' 2025-11-27T00:44:15,322 adding 'lm_eval/tasks/global_piqa/completions/rwr_deva.yaml' 2025-11-27T00:44:15,324 adding 'lm_eval/tasks/global_piqa/completions/sin_sinh.yaml' 2025-11-27T00:44:15,325 adding 'lm_eval/tasks/global_piqa/completions/slk_latn.yaml' 2025-11-27T00:44:15,326 adding 'lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml' 2025-11-27T00:44:15,327 adding 'lm_eval/tasks/global_piqa/completions/slv_latn.yaml' 2025-11-27T00:44:15,328 adding 'lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml' 2025-11-27T00:44:15,329 adding 'lm_eval/tasks/global_piqa/completions/snd_arab.yaml' 2025-11-27T00:44:15,330 adding 'lm_eval/tasks/global_piqa/completions/snd_deva.yaml' 2025-11-27T00:44:15,331 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml' 2025-11-27T00:44:15,333 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml' 2025-11-27T00:44:15,334 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml' 2025-11-27T00:44:15,335 adding 'lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml' 2025-11-27T00:44:15,336 adding 'lm_eval/tasks/global_piqa/completions/srp_latn.yaml' 2025-11-27T00:44:15,337 adding 'lm_eval/tasks/global_piqa/completions/swe_latn.yaml' 2025-11-27T00:44:15,338 adding 'lm_eval/tasks/global_piqa/completions/swh_latn.yaml' 2025-11-27T00:44:15,339 adding 'lm_eval/tasks/global_piqa/completions/tam_taml.yaml' 2025-11-27T00:44:15,340 adding 'lm_eval/tasks/global_piqa/completions/tel_telu.yaml' 2025-11-27T00:44:15,341 adding 'lm_eval/tasks/global_piqa/completions/tgl_latn.yaml' 2025-11-27T00:44:15,343 adding 'lm_eval/tasks/global_piqa/completions/tha_thai.yaml' 2025-11-27T00:44:15,344 adding 'lm_eval/tasks/global_piqa/completions/tur_latn.yaml' 2025-11-27T00:44:15,345 adding 'lm_eval/tasks/global_piqa/completions/uig_arab.yaml' 2025-11-27T00:44:15,346 adding 'lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml' 2025-11-27T00:44:15,347 adding 'lm_eval/tasks/global_piqa/completions/urd_arab.yaml' 2025-11-27T00:44:15,348 adding 'lm_eval/tasks/global_piqa/completions/urd_latn.yaml' 2025-11-27T00:44:15,349 adding 'lm_eval/tasks/global_piqa/completions/urh_latn.yaml' 2025-11-27T00:44:15,351 adding 'lm_eval/tasks/global_piqa/completions/uzn_latn.yaml' 2025-11-27T00:44:15,352 adding 'lm_eval/tasks/global_piqa/completions/vie_latn.yaml' 2025-11-27T00:44:15,353 adding 'lm_eval/tasks/global_piqa/completions/yor_latn.yaml' 2025-11-27T00:44:15,354 adding 'lm_eval/tasks/global_piqa/completions/yue_hant.yaml' 2025-11-27T00:44:15,355 adding 'lm_eval/tasks/global_piqa/completions/zsm_latn.yaml' 2025-11-27T00:44:15,356 adding 'lm_eval/tasks/global_piqa/completions/zul_latn.yaml' 2025-11-27T00:44:15,360 adding 'lm_eval/tasks/global_piqa/prompted/_generate_config.py' 2025-11-27T00:44:15,362 adding 'lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml' 2025-11-27T00:44:15,363 adding 'lm_eval/tasks/global_piqa/prompted/_template' 2025-11-27T00:44:15,364 adding 'lm_eval/tasks/global_piqa/prompted/acm_arab.yaml' 2025-11-27T00:44:15,365 adding 'lm_eval/tasks/global_piqa/prompted/acq_arab.yaml' 2025-11-27T00:44:15,367 adding 'lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml' 2025-11-27T00:44:15,368 adding 'lm_eval/tasks/global_piqa/prompted/afb_arab.yaml' 2025-11-27T00:44:15,369 adding 'lm_eval/tasks/global_piqa/prompted/als_latn.yaml' 2025-11-27T00:44:15,370 adding 'lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml' 2025-11-27T00:44:15,371 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml' 2025-11-27T00:44:15,372 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml' 2025-11-27T00:44:15,373 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml' 2025-11-27T00:44:15,374 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml' 2025-11-27T00:44:15,375 adding 'lm_eval/tasks/global_piqa/prompted/arb_arab.yaml' 2025-11-27T00:44:15,376 adding 'lm_eval/tasks/global_piqa/prompted/arq_arab.yaml' 2025-11-27T00:44:15,377 adding 'lm_eval/tasks/global_piqa/prompted/ars_arab.yaml' 2025-11-27T00:44:15,378 adding 'lm_eval/tasks/global_piqa/prompted/ary_arab.yaml' 2025-11-27T00:44:15,379 adding 'lm_eval/tasks/global_piqa/prompted/arz_arab.yaml' 2025-11-27T00:44:15,381 adding 'lm_eval/tasks/global_piqa/prompted/asm_beng.yaml' 2025-11-27T00:44:15,382 adding 'lm_eval/tasks/global_piqa/prompted/azj_latn.yaml' 2025-11-27T00:44:15,383 adding 'lm_eval/tasks/global_piqa/prompted/bam_latn.yaml' 2025-11-27T00:44:15,384 adding 'lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml' 2025-11-27T00:44:15,385 adding 'lm_eval/tasks/global_piqa/prompted/ben_beng.yaml' 2025-11-27T00:44:15,386 adding 'lm_eval/tasks/global_piqa/prompted/ben_latn.yaml' 2025-11-27T00:44:15,387 adding 'lm_eval/tasks/global_piqa/prompted/bho_deva.yaml' 2025-11-27T00:44:15,388 adding 'lm_eval/tasks/global_piqa/prompted/bos_latn.yaml' 2025-11-27T00:44:15,389 adding 'lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml' 2025-11-27T00:44:15,391 adding 'lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml' 2025-11-27T00:44:15,392 adding 'lm_eval/tasks/global_piqa/prompted/cat_latn.yaml' 2025-11-27T00:44:15,393 adding 'lm_eval/tasks/global_piqa/prompted/ces_latn.yaml' 2025-11-27T00:44:15,394 adding 'lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml' 2025-11-27T00:44:15,395 adding 'lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml' 2025-11-27T00:44:15,396 adding 'lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml' 2025-11-27T00:44:15,397 adding 'lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml' 2025-11-27T00:44:15,398 adding 'lm_eval/tasks/global_piqa/prompted/deu_latn.yaml' 2025-11-27T00:44:15,400 adding 'lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml' 2025-11-27T00:44:15,401 adding 'lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml' 2025-11-27T00:44:15,402 adding 'lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml' 2025-11-27T00:44:15,403 adding 'lm_eval/tasks/global_piqa/prompted/ell_grek.yaml' 2025-11-27T00:44:15,404 adding 'lm_eval/tasks/global_piqa/prompted/eng_latn.yaml' 2025-11-27T00:44:15,405 adding 'lm_eval/tasks/global_piqa/prompted/fao_latn.yaml' 2025-11-27T00:44:15,406 adding 'lm_eval/tasks/global_piqa/prompted/fin_latn.yaml' 2025-11-27T00:44:15,408 adding 'lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml' 2025-11-27T00:44:15,409 adding 'lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml' 2025-11-27T00:44:15,410 adding 'lm_eval/tasks/global_piqa/prompted/glg_latn.yaml' 2025-11-27T00:44:15,411 adding 'lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml' 2025-11-27T00:44:15,412 adding 'lm_eval/tasks/global_piqa/prompted/hau_latn.yaml' 2025-11-27T00:44:15,413 adding 'lm_eval/tasks/global_piqa/prompted/haw_latn.yaml' 2025-11-27T00:44:15,414 adding 'lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml' 2025-11-27T00:44:15,416 adding 'lm_eval/tasks/global_piqa/prompted/hin_deva.yaml' 2025-11-27T00:44:15,417 adding 'lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml' 2025-11-27T00:44:15,418 adding 'lm_eval/tasks/global_piqa/prompted/hun_latn.yaml' 2025-11-27T00:44:15,419 adding 'lm_eval/tasks/global_piqa/prompted/hye_armn.yaml' 2025-11-27T00:44:15,420 adding 'lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml' 2025-11-27T00:44:15,421 adding 'lm_eval/tasks/global_piqa/prompted/idu_latn.yaml' 2025-11-27T00:44:15,423 adding 'lm_eval/tasks/global_piqa/prompted/ind_latn.yaml' 2025-11-27T00:44:15,424 adding 'lm_eval/tasks/global_piqa/prompted/isl_latn.yaml' 2025-11-27T00:44:15,425 adding 'lm_eval/tasks/global_piqa/prompted/iso_latn.yaml' 2025-11-27T00:44:15,426 adding 'lm_eval/tasks/global_piqa/prompted/ita_latn.yaml' 2025-11-27T00:44:15,427 adding 'lm_eval/tasks/global_piqa/prompted/jav_latn.yaml' 2025-11-27T00:44:15,428 adding 'lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml' 2025-11-27T00:44:15,429 adding 'lm_eval/tasks/global_piqa/prompted/kan_knda.yaml' 2025-11-27T00:44:15,430 adding 'lm_eval/tasks/global_piqa/prompted/kat_geor.yaml' 2025-11-27T00:44:15,431 adding 'lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml' 2025-11-27T00:44:15,432 adding 'lm_eval/tasks/global_piqa/prompted/kin_latn.yaml' 2025-11-27T00:44:15,433 adding 'lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml' 2025-11-27T00:44:15,434 adding 'lm_eval/tasks/global_piqa/prompted/kor_hang.yaml' 2025-11-27T00:44:15,436 adding 'lm_eval/tasks/global_piqa/prompted/lin_latn.yaml' 2025-11-27T00:44:15,437 adding 'lm_eval/tasks/global_piqa/prompted/lit_latn.yaml' 2025-11-27T00:44:15,438 adding 'lm_eval/tasks/global_piqa/prompted/luo_latn.yaml' 2025-11-27T00:44:15,439 adding 'lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml' 2025-11-27T00:44:15,440 adding 'lm_eval/tasks/global_piqa/prompted/mar_deva.yaml' 2025-11-27T00:44:15,441 adding 'lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml' 2025-11-27T00:44:15,442 adding 'lm_eval/tasks/global_piqa/prompted/mni_beng.yaml' 2025-11-27T00:44:15,443 adding 'lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml' 2025-11-27T00:44:15,445 adding 'lm_eval/tasks/global_piqa/prompted/nag_latn.yaml' 2025-11-27T00:44:15,446 adding 'lm_eval/tasks/global_piqa/prompted/nld_latn.yaml' 2025-11-27T00:44:15,447 adding 'lm_eval/tasks/global_piqa/prompted/nno_latn.yaml' 2025-11-27T00:44:15,448 adding 'lm_eval/tasks/global_piqa/prompted/nob_latn.yaml' 2025-11-27T00:44:15,449 adding 'lm_eval/tasks/global_piqa/prompted/npi_deva.yaml' 2025-11-27T00:44:15,450 adding 'lm_eval/tasks/global_piqa/prompted/pan_guru.yaml' 2025-11-27T00:44:15,451 adding 'lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml' 2025-11-27T00:44:15,452 adding 'lm_eval/tasks/global_piqa/prompted/pes_arab.yaml' 2025-11-27T00:44:15,453 adding 'lm_eval/tasks/global_piqa/prompted/pol_latn.yaml' 2025-11-27T00:44:15,455 adding 'lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml' 2025-11-27T00:44:15,456 adding 'lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml' 2025-11-27T00:44:15,457 adding 'lm_eval/tasks/global_piqa/prompted/ron_latn.yaml' 2025-11-27T00:44:15,458 adding 'lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml' 2025-11-27T00:44:15,459 adding 'lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml' 2025-11-27T00:44:15,460 adding 'lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml' 2025-11-27T00:44:15,461 adding 'lm_eval/tasks/global_piqa/prompted/slk_latn.yaml' 2025-11-27T00:44:15,463 adding 'lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml' 2025-11-27T00:44:15,464 adding 'lm_eval/tasks/global_piqa/prompted/slv_latn.yaml' 2025-11-27T00:44:15,465 adding 'lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml' 2025-11-27T00:44:15,466 adding 'lm_eval/tasks/global_piqa/prompted/snd_arab.yaml' 2025-11-27T00:44:15,467 adding 'lm_eval/tasks/global_piqa/prompted/snd_deva.yaml' 2025-11-27T00:44:15,468 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml' 2025-11-27T00:44:15,469 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml' 2025-11-27T00:44:15,471 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml' 2025-11-27T00:44:15,472 adding 'lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml' 2025-11-27T00:44:15,473 adding 'lm_eval/tasks/global_piqa/prompted/srp_latn.yaml' 2025-11-27T00:44:15,474 adding 'lm_eval/tasks/global_piqa/prompted/swe_latn.yaml' 2025-11-27T00:44:15,475 adding 'lm_eval/tasks/global_piqa/prompted/swh_latn.yaml' 2025-11-27T00:44:15,477 adding 'lm_eval/tasks/global_piqa/prompted/tam_taml.yaml' 2025-11-27T00:44:15,478 adding 'lm_eval/tasks/global_piqa/prompted/tel_telu.yaml' 2025-11-27T00:44:15,479 adding 'lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml' 2025-11-27T00:44:15,480 adding 'lm_eval/tasks/global_piqa/prompted/tha_thai.yaml' 2025-11-27T00:44:15,481 adding 'lm_eval/tasks/global_piqa/prompted/tur_latn.yaml' 2025-11-27T00:44:15,482 adding 'lm_eval/tasks/global_piqa/prompted/uig_arab.yaml' 2025-11-27T00:44:15,483 adding 'lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml' 2025-11-27T00:44:15,484 adding 'lm_eval/tasks/global_piqa/prompted/urd_arab.yaml' 2025-11-27T00:44:15,485 adding 'lm_eval/tasks/global_piqa/prompted/urd_latn.yaml' 2025-11-27T00:44:15,486 adding 'lm_eval/tasks/global_piqa/prompted/urh_latn.yaml' 2025-11-27T00:44:15,487 adding 'lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml' 2025-11-27T00:44:15,488 adding 'lm_eval/tasks/global_piqa/prompted/vie_latn.yaml' 2025-11-27T00:44:15,490 adding 'lm_eval/tasks/global_piqa/prompted/yor_latn.yaml' 2025-11-27T00:44:15,491 adding 'lm_eval/tasks/global_piqa/prompted/yue_hant.yaml' 2025-11-27T00:44:15,492 adding 'lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml' 2025-11-27T00:44:15,493 adding 'lm_eval/tasks/global_piqa/prompted/zul_latn.yaml' 2025-11-27T00:44:15,495 adding 'lm_eval/tasks/glue/README.md' 2025-11-27T00:44:15,497 adding 'lm_eval/tasks/glue/cola/default.yaml' 2025-11-27T00:44:15,499 adding 'lm_eval/tasks/glue/mnli/default.yaml' 2025-11-27T00:44:15,500 adding 'lm_eval/tasks/glue/mnli/mismatch.yaml' 2025-11-27T00:44:15,501 adding 'lm_eval/tasks/glue/mnli/utils.py' 2025-11-27T00:44:15,503 adding 'lm_eval/tasks/glue/mrpc/default.yaml' 2025-11-27T00:44:15,504 adding 'lm_eval/tasks/glue/qnli/default.yaml' 2025-11-27T00:44:15,506 adding 'lm_eval/tasks/glue/qqp/default.yaml' 2025-11-27T00:44:15,508 adding 'lm_eval/tasks/glue/rte/default.yaml' 2025-11-27T00:44:15,510 adding 'lm_eval/tasks/glue/sst2/default.yaml' 2025-11-27T00:44:15,511 adding 'lm_eval/tasks/glue/wnli/default.yaml' 2025-11-27T00:44:15,513 adding 'lm_eval/tasks/gpqa/README.md' 2025-11-27T00:44:15,515 adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py' 2025-11-27T00:44:15,516 adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml' 2025-11-27T00:44:15,517 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml' 2025-11-27T00:44:15,519 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml' 2025-11-27T00:44:15,520 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml' 2025-11-27T00:44:15,521 adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py' 2025-11-27T00:44:15,523 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py' 2025-11-27T00:44:15,524 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml' 2025-11-27T00:44:15,525 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml' 2025-11-27T00:44:15,527 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml' 2025-11-27T00:44:15,528 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml' 2025-11-27T00:44:15,529 adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py' 2025-11-27T00:44:15,531 adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py' 2025-11-27T00:44:15,532 adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml' 2025-11-27T00:44:15,534 adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml' 2025-11-27T00:44:15,535 adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml' 2025-11-27T00:44:15,536 adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml' 2025-11-27T00:44:15,537 adding 'lm_eval/tasks/gpqa/generative/utils.py' 2025-11-27T00:44:15,539 adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py' 2025-11-27T00:44:15,541 adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml' 2025-11-27T00:44:15,542 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml' 2025-11-27T00:44:15,543 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml' 2025-11-27T00:44:15,544 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml' 2025-11-27T00:44:15,545 adding 'lm_eval/tasks/gpqa/n_shot/utils.py' 2025-11-27T00:44:15,547 adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py' 2025-11-27T00:44:15,548 adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml' 2025-11-27T00:44:15,549 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml' 2025-11-27T00:44:15,551 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml' 2025-11-27T00:44:15,552 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml' 2025-11-27T00:44:15,553 adding 'lm_eval/tasks/gpqa/zeroshot/utils.py' 2025-11-27T00:44:15,555 adding 'lm_eval/tasks/graphwalks/README.md' 2025-11-27T00:44:15,556 adding 'lm_eval/tasks/graphwalks/graphwalks.yaml' 2025-11-27T00:44:15,557 adding 'lm_eval/tasks/graphwalks/graphwalks_128k.yaml' 2025-11-27T00:44:15,558 adding 'lm_eval/tasks/graphwalks/graphwalks_1M.yaml' 2025-11-27T00:44:15,560 adding 'lm_eval/tasks/graphwalks/utils.py' 2025-11-27T00:44:15,561 adding 'lm_eval/tasks/groundcocoa/README.md' 2025-11-27T00:44:15,563 adding 'lm_eval/tasks/groundcocoa/groundcocoa.yaml' 2025-11-27T00:44:15,564 adding 'lm_eval/tasks/groundcocoa/utils.py' 2025-11-27T00:44:15,566 adding 'lm_eval/tasks/gsm8k/README.md' 2025-11-27T00:44:15,567 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml' 2025-11-27T00:44:15,568 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml' 2025-11-27T00:44:15,570 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml' 2025-11-27T00:44:15,571 adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml' 2025-11-27T00:44:15,572 adding 'lm_eval/tasks/gsm8k/gsm8k.yaml' 2025-11-27T00:44:15,574 adding 'lm_eval/tasks/gsm8k_platinum/README.md' 2025-11-27T00:44:15,576 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml' 2025-11-27T00:44:15,577 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml' 2025-11-27T00:44:15,578 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml' 2025-11-27T00:44:15,580 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml' 2025-11-27T00:44:15,581 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml' 2025-11-27T00:44:15,583 adding 'lm_eval/tasks/gsm_plus/README.md' 2025-11-27T00:44:15,584 adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml' 2025-11-27T00:44:15,585 adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml' 2025-11-27T00:44:15,587 adding 'lm_eval/tasks/haerae/README.md' 2025-11-27T00:44:15,589 adding 'lm_eval/tasks/haerae/_default_haerae_yaml' 2025-11-27T00:44:15,590 adding 'lm_eval/tasks/haerae/_haerae.yaml' 2025-11-27T00:44:15,591 adding 'lm_eval/tasks/haerae/haerae_gk.yaml' 2025-11-27T00:44:15,592 adding 'lm_eval/tasks/haerae/haerae_hi.yaml' 2025-11-27T00:44:15,593 adding 'lm_eval/tasks/haerae/haerae_lw.yaml' 2025-11-27T00:44:15,594 adding 'lm_eval/tasks/haerae/haerae_rw.yaml' 2025-11-27T00:44:15,595 adding 'lm_eval/tasks/haerae/haerae_sn.yaml' 2025-11-27T00:44:15,597 adding 'lm_eval/tasks/headqa/README.md' 2025-11-27T00:44:15,599 adding 'lm_eval/tasks/headqa/headqa_en.yaml' 2025-11-27T00:44:15,600 adding 'lm_eval/tasks/headqa/headqa_es.yaml' 2025-11-27T00:44:15,602 adding 'lm_eval/tasks/hellaswag/README.md' 2025-11-27T00:44:15,603 adding 'lm_eval/tasks/hellaswag/hellaswag.yaml' 2025-11-27T00:44:15,605 adding 'lm_eval/tasks/hellaswag/utils.py' 2025-11-27T00:44:15,607 adding 'lm_eval/tasks/hendrycks_ethics/README.md' 2025-11-27T00:44:15,608 adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml' 2025-11-27T00:44:15,609 adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml' 2025-11-27T00:44:15,611 adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml' 2025-11-27T00:44:15,612 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml' 2025-11-27T00:44:15,613 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml' 2025-11-27T00:44:15,615 adding 'lm_eval/tasks/hendrycks_ethics/utils.py' 2025-11-27T00:44:15,616 adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml' 2025-11-27T00:44:15,618 adding 'lm_eval/tasks/hendrycks_math/README.md' 2025-11-27T00:44:15,619 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml' 2025-11-27T00:44:15,620 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml' 2025-11-27T00:44:15,621 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml' 2025-11-27T00:44:15,622 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml' 2025-11-27T00:44:15,623 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml' 2025-11-27T00:44:15,624 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml' 2025-11-27T00:44:15,625 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml' 2025-11-27T00:44:15,626 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml' 2025-11-27T00:44:15,627 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml' 2025-11-27T00:44:15,629 adding 'lm_eval/tasks/hendrycks_math/utils.py' 2025-11-27T00:44:15,631 adding 'lm_eval/tasks/histoires_morales/README.md' 2025-11-27T00:44:15,632 adding 'lm_eval/tasks/histoires_morales/histoires_morales.yaml' 2025-11-27T00:44:15,633 adding 'lm_eval/tasks/histoires_morales/utils.py' 2025-11-27T00:44:15,635 adding 'lm_eval/tasks/hrm8k/README.md' 2025-11-27T00:44:15,637 adding 'lm_eval/tasks/hrm8k/default/_hrm8k_yaml' 2025-11-27T00:44:15,638 adding 'lm_eval/tasks/hrm8k/default/hrm8k.yaml' 2025-11-27T00:44:15,639 adding 'lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml' 2025-11-27T00:44:15,640 adding 'lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml' 2025-11-27T00:44:15,642 adding 'lm_eval/tasks/hrm8k/default/hrm8k_math.yaml' 2025-11-27T00:44:15,643 adding 'lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml' 2025-11-27T00:44:15,644 adding 'lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml' 2025-11-27T00:44:15,646 adding 'lm_eval/tasks/hrm8k/default/utils.py' 2025-11-27T00:44:15,647 adding 'lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml' 2025-11-27T00:44:15,649 adding 'lm_eval/tasks/hrm8k/en/hrm8k_en.yaml' 2025-11-27T00:44:15,650 adding 'lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml' 2025-11-27T00:44:15,651 adding 'lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml' 2025-11-27T00:44:15,652 adding 'lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml' 2025-11-27T00:44:15,653 adding 'lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml' 2025-11-27T00:44:15,654 adding 'lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml' 2025-11-27T00:44:15,656 adding 'lm_eval/tasks/hrm8k/en/utils.py' 2025-11-27T00:44:15,658 adding 'lm_eval/tasks/humaneval/README.md' 2025-11-27T00:44:15,659 adding 'lm_eval/tasks/humaneval/humaneval.yaml' 2025-11-27T00:44:15,661 adding 'lm_eval/tasks/humaneval/humaneval_64.yaml' 2025-11-27T00:44:15,662 adding 'lm_eval/tasks/humaneval/humaneval_64_instruct.yaml' 2025-11-27T00:44:15,663 adding 'lm_eval/tasks/humaneval/humaneval_instruct.yaml' 2025-11-27T00:44:15,664 adding 'lm_eval/tasks/humaneval/humaneval_plus.yaml' 2025-11-27T00:44:15,665 adding 'lm_eval/tasks/humaneval/utils.py' 2025-11-27T00:44:15,667 adding 'lm_eval/tasks/humaneval_infilling/README.md' 2025-11-27T00:44:15,669 adding 'lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml' 2025-11-27T00:44:15,670 adding 'lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml' 2025-11-27T00:44:15,671 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml' 2025-11-27T00:44:15,672 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml' 2025-11-27T00:44:15,673 adding 'lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml' 2025-11-27T00:44:15,675 adding 'lm_eval/tasks/humaneval_infilling/utils.py' 2025-11-27T00:44:15,677 adding 'lm_eval/tasks/icelandic_winogrande/README.md' 2025-11-27T00:44:15,678 adding 'lm_eval/tasks/icelandic_winogrande/default.yaml' 2025-11-27T00:44:15,679 adding 'lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py' 2025-11-27T00:44:15,681 adding 'lm_eval/tasks/ifeval/README.md' 2025-11-27T00:44:15,682 adding 'lm_eval/tasks/ifeval/ifeval.yaml' 2025-11-27T00:44:15,687 adding 'lm_eval/tasks/ifeval/instructions.py' 2025-11-27T00:44:15,689 adding 'lm_eval/tasks/ifeval/instructions_registry.py' 2025-11-27T00:44:15,693 adding 'lm_eval/tasks/ifeval/instructions_util.py' 2025-11-27T00:44:15,694 adding 'lm_eval/tasks/ifeval/utils.py' 2025-11-27T00:44:15,696 adding 'lm_eval/tasks/include/README.md' 2025-11-27T00:44:15,699 adding 'lm_eval/tasks/include/default/Albanian/_albanian_template_yaml' 2025-11-27T00:44:15,700 adding 'lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml' 2025-11-27T00:44:15,701 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml' 2025-11-27T00:44:15,702 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml' 2025-11-27T00:44:15,703 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2025-11-27T00:44:15,704 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml' 2025-11-27T00:44:15,705 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml' 2025-11-27T00:44:15,707 adding 'lm_eval/tasks/include/default/Albanian/utils.py' 2025-11-27T00:44:15,709 adding 'lm_eval/tasks/include/default/Arabic/_arabic_template_yaml' 2025-11-27T00:44:15,710 adding 'lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml' 2025-11-27T00:44:15,711 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml' 2025-11-27T00:44:15,712 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml' 2025-11-27T00:44:15,713 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml' 2025-11-27T00:44:15,714 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml' 2025-11-27T00:44:15,715 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml' 2025-11-27T00:44:15,716 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml' 2025-11-27T00:44:15,718 adding 'lm_eval/tasks/include/default/Arabic/utils.py' 2025-11-27T00:44:15,719 adding 'lm_eval/tasks/include/default/Armenian/_armenian_template_yaml' 2025-11-27T00:44:15,721 adding 'lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml' 2025-11-27T00:44:15,722 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml' 2025-11-27T00:44:15,723 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml' 2025-11-27T00:44:15,724 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml' 2025-11-27T00:44:15,725 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml' 2025-11-27T00:44:15,726 adding 'lm_eval/tasks/include/default/Armenian/utils.py' 2025-11-27T00:44:15,728 adding 'lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml' 2025-11-27T00:44:15,730 adding 'lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml' 2025-11-27T00:44:15,731 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2025-11-27T00:44:15,732 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2025-11-27T00:44:15,733 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2025-11-27T00:44:15,734 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2025-11-27T00:44:15,735 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2025-11-27T00:44:15,737 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2025-11-27T00:44:15,738 adding 'lm_eval/tasks/include/default/Azerbaijani/utils.py' 2025-11-27T00:44:15,740 adding 'lm_eval/tasks/include/default/Basque/_basque_template_yaml' 2025-11-27T00:44:15,741 adding 'lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml' 2025-11-27T00:44:15,742 adding 'lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml' 2025-11-27T00:44:15,743 adding 'lm_eval/tasks/include/default/Basque/utils.py' 2025-11-27T00:44:15,745 adding 'lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml' 2025-11-27T00:44:15,746 adding 'lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml' 2025-11-27T00:44:15,747 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2025-11-27T00:44:15,748 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml' 2025-11-27T00:44:15,749 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml' 2025-11-27T00:44:15,750 adding 'lm_eval/tasks/include/default/Belarusian/utils.py' 2025-11-27T00:44:15,752 adding 'lm_eval/tasks/include/default/Bengali/_bengali_template_yaml' 2025-11-27T00:44:15,753 adding 'lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml' 2025-11-27T00:44:15,754 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml' 2025-11-27T00:44:15,756 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml' 2025-11-27T00:44:15,757 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml' 2025-11-27T00:44:15,758 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml' 2025-11-27T00:44:15,759 adding 'lm_eval/tasks/include/default/Bengali/utils.py' 2025-11-27T00:44:15,761 adding 'lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml' 2025-11-27T00:44:15,762 adding 'lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml' 2025-11-27T00:44:15,763 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2025-11-27T00:44:15,764 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2025-11-27T00:44:15,765 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml' 2025-11-27T00:44:15,767 adding 'lm_eval/tasks/include/default/Bulgarian/utils.py' 2025-11-27T00:44:15,769 adding 'lm_eval/tasks/include/default/Chinese/_chinese_template_yaml' 2025-11-27T00:44:15,770 adding 'lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml' 2025-11-27T00:44:15,771 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml' 2025-11-27T00:44:15,772 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml' 2025-11-27T00:44:15,773 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml' 2025-11-27T00:44:15,775 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml' 2025-11-27T00:44:15,776 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2025-11-27T00:44:15,777 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml' 2025-11-27T00:44:15,778 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml' 2025-11-27T00:44:15,779 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml' 2025-11-27T00:44:15,781 adding 'lm_eval/tasks/include/default/Chinese/utils.py' 2025-11-27T00:44:15,782 adding 'lm_eval/tasks/include/default/Croatian/_croatian_template_yaml' 2025-11-27T00:44:15,784 adding 'lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml' 2025-11-27T00:44:15,785 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml' 2025-11-27T00:44:15,786 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml' 2025-11-27T00:44:15,787 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml' 2025-11-27T00:44:15,788 adding 'lm_eval/tasks/include/default/Croatian/utils.py' 2025-11-27T00:44:15,790 adding 'lm_eval/tasks/include/default/Dutch/_dutch_template_yaml' 2025-11-27T00:44:15,791 adding 'lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml' 2025-11-27T00:44:15,792 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml' 2025-11-27T00:44:15,793 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml' 2025-11-27T00:44:15,794 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2025-11-27T00:44:15,796 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml' 2025-11-27T00:44:15,797 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml' 2025-11-27T00:44:15,798 adding 'lm_eval/tasks/include/default/Dutch/utils.py' 2025-11-27T00:44:15,800 adding 'lm_eval/tasks/include/default/Estonian/_estonian_template_yaml' 2025-11-27T00:44:15,801 adding 'lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml' 2025-11-27T00:44:15,802 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml' 2025-11-27T00:44:15,803 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml' 2025-11-27T00:44:15,804 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2025-11-27T00:44:15,806 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml' 2025-11-27T00:44:15,807 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml' 2025-11-27T00:44:15,808 adding 'lm_eval/tasks/include/default/Estonian/utils.py' 2025-11-27T00:44:15,810 adding 'lm_eval/tasks/include/default/Finnish/_finnish_template_yaml' 2025-11-27T00:44:15,811 adding 'lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml' 2025-11-27T00:44:15,812 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml' 2025-11-27T00:44:15,813 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml' 2025-11-27T00:44:15,815 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2025-11-27T00:44:15,816 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml' 2025-11-27T00:44:15,817 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml' 2025-11-27T00:44:15,818 adding 'lm_eval/tasks/include/default/Finnish/utils.py' 2025-11-27T00:44:15,820 adding 'lm_eval/tasks/include/default/French/_french_template_yaml' 2025-11-27T00:44:15,821 adding 'lm_eval/tasks/include/default/French/_include_base_44_french.yaml' 2025-11-27T00:44:15,822 adding 'lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml' 2025-11-27T00:44:15,824 adding 'lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml' 2025-11-27T00:44:15,825 adding 'lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml' 2025-11-27T00:44:15,826 adding 'lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml' 2025-11-27T00:44:15,827 adding 'lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml' 2025-11-27T00:44:15,828 adding 'lm_eval/tasks/include/default/French/utils.py' 2025-11-27T00:44:15,830 adding 'lm_eval/tasks/include/default/Georgian/_georgian_template_yaml' 2025-11-27T00:44:15,831 adding 'lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml' 2025-11-27T00:44:15,832 adding 'lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml' 2025-11-27T00:44:15,834 adding 'lm_eval/tasks/include/default/Georgian/utils.py' 2025-11-27T00:44:15,836 adding 'lm_eval/tasks/include/default/German/_german_template_yaml' 2025-11-27T00:44:15,837 adding 'lm_eval/tasks/include/default/German/_include_base_44_german.yaml' 2025-11-27T00:44:15,838 adding 'lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml' 2025-11-27T00:44:15,839 adding 'lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml' 2025-11-27T00:44:15,840 adding 'lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml' 2025-11-27T00:44:15,841 adding 'lm_eval/tasks/include/default/German/utils.py' 2025-11-27T00:44:15,843 adding 'lm_eval/tasks/include/default/Greek/_greek_template_yaml' 2025-11-27T00:44:15,844 adding 'lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml' 2025-11-27T00:44:15,845 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml' 2025-11-27T00:44:15,846 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml' 2025-11-27T00:44:15,847 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml' 2025-11-27T00:44:15,849 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml' 2025-11-27T00:44:15,850 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml' 2025-11-27T00:44:15,851 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml' 2025-11-27T00:44:15,852 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml' 2025-11-27T00:44:15,853 adding 'lm_eval/tasks/include/default/Greek/utils.py' 2025-11-27T00:44:15,855 adding 'lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml' 2025-11-27T00:44:15,856 adding 'lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml' 2025-11-27T00:44:15,857 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2025-11-27T00:44:15,859 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml' 2025-11-27T00:44:15,860 adding 'lm_eval/tasks/include/default/Hebrew/utils.py' 2025-11-27T00:44:15,862 adding 'lm_eval/tasks/include/default/Hindi/_hindi_template_yaml' 2025-11-27T00:44:15,863 adding 'lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml' 2025-11-27T00:44:15,864 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml' 2025-11-27T00:44:15,865 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml' 2025-11-27T00:44:15,866 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml' 2025-11-27T00:44:15,868 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml' 2025-11-27T00:44:15,869 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2025-11-27T00:44:15,870 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml' 2025-11-27T00:44:15,871 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml' 2025-11-27T00:44:15,872 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml' 2025-11-27T00:44:15,874 adding 'lm_eval/tasks/include/default/Hindi/utils.py' 2025-11-27T00:44:15,875 adding 'lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml' 2025-11-27T00:44:15,877 adding 'lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml' 2025-11-27T00:44:15,878 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml' 2025-11-27T00:44:15,879 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml' 2025-11-27T00:44:15,880 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml' 2025-11-27T00:44:15,881 adding 'lm_eval/tasks/include/default/Hungarian/utils.py' 2025-11-27T00:44:15,883 adding 'lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml' 2025-11-27T00:44:15,885 adding 'lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml' 2025-11-27T00:44:15,886 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml' 2025-11-27T00:44:15,887 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2025-11-27T00:44:15,888 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2025-11-27T00:44:15,889 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml' 2025-11-27T00:44:15,890 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml' 2025-11-27T00:44:15,891 adding 'lm_eval/tasks/include/default/Indonesian/utils.py' 2025-11-27T00:44:15,893 adding 'lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml' 2025-11-27T00:44:15,894 adding 'lm_eval/tasks/include/default/Italian/_italian_template_yaml' 2025-11-27T00:44:15,895 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml' 2025-11-27T00:44:15,897 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml' 2025-11-27T00:44:15,898 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml' 2025-11-27T00:44:15,899 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml' 2025-11-27T00:44:15,900 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml' 2025-11-27T00:44:15,901 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml' 2025-11-27T00:44:15,902 adding 'lm_eval/tasks/include/default/Italian/utils.py' 2025-11-27T00:44:15,904 adding 'lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml' 2025-11-27T00:44:15,905 adding 'lm_eval/tasks/include/default/Japanese/_japanese_template_yaml' 2025-11-27T00:44:15,907 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml' 2025-11-27T00:44:15,908 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml' 2025-11-27T00:44:15,909 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml' 2025-11-27T00:44:15,910 adding 'lm_eval/tasks/include/default/Japanese/utils.py' 2025-11-27T00:44:15,912 adding 'lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml' 2025-11-27T00:44:15,913 adding 'lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml' 2025-11-27T00:44:15,914 adding 'lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2025-11-27T00:44:15,915 adding 'lm_eval/tasks/include/default/Kazakh/utils.py' 2025-11-27T00:44:15,917 adding 'lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml' 2025-11-27T00:44:15,918 adding 'lm_eval/tasks/include/default/Korean/_korean_template_yaml' 2025-11-27T00:44:15,920 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml' 2025-11-27T00:44:15,921 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml' 2025-11-27T00:44:15,922 adding 'lm_eval/tasks/include/default/Korean/utils.py' 2025-11-27T00:44:15,924 adding 'lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml' 2025-11-27T00:44:15,925 adding 'lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml' 2025-11-27T00:44:15,926 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2025-11-27T00:44:15,928 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2025-11-27T00:44:15,929 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2025-11-27T00:44:15,930 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2025-11-27T00:44:15,931 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml' 2025-11-27T00:44:15,933 adding 'lm_eval/tasks/include/default/Lithuanian/utils.py' 2025-11-27T00:44:15,934 adding 'lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml' 2025-11-27T00:44:15,935 adding 'lm_eval/tasks/include/default/Malay/_malay_template_yaml' 2025-11-27T00:44:15,936 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml' 2025-11-27T00:44:15,938 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml' 2025-11-27T00:44:15,939 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml' 2025-11-27T00:44:15,940 adding 'lm_eval/tasks/include/default/Malay/utils.py' 2025-11-27T00:44:15,942 adding 'lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml' 2025-11-27T00:44:15,943 adding 'lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml' 2025-11-27T00:44:15,944 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2025-11-27T00:44:15,945 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2025-11-27T00:44:15,947 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2025-11-27T00:44:15,948 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml' 2025-11-27T00:44:15,949 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml' 2025-11-27T00:44:15,950 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml' 2025-11-27T00:44:15,952 adding 'lm_eval/tasks/include/default/Malayalam/utils.py' 2025-11-27T00:44:15,953 adding 'lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml' 2025-11-27T00:44:15,955 adding 'lm_eval/tasks/include/default/Nepali/_nepali_template_yaml' 2025-11-27T00:44:15,956 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml' 2025-11-27T00:44:15,957 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml' 2025-11-27T00:44:15,959 adding 'lm_eval/tasks/include/default/Nepali/utils.py' 2025-11-27T00:44:15,961 adding 'lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml' 2025-11-27T00:44:15,962 adding 'lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml' 2025-11-27T00:44:15,963 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2025-11-27T00:44:15,965 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2025-11-27T00:44:15,967 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2025-11-27T00:44:15,968 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml' 2025-11-27T00:44:15,969 adding 'lm_eval/tasks/include/default/North Macedonian/utils.py' 2025-11-27T00:44:15,971 adding 'lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml' 2025-11-27T00:44:15,973 adding 'lm_eval/tasks/include/default/Persian/_persian_template_yaml' 2025-11-27T00:44:15,974 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml' 2025-11-27T00:44:15,975 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml' 2025-11-27T00:44:15,976 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml' 2025-11-27T00:44:15,977 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml' 2025-11-27T00:44:15,979 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml' 2025-11-27T00:44:15,980 adding 'lm_eval/tasks/include/default/Persian/utils.py' 2025-11-27T00:44:15,982 adding 'lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml' 2025-11-27T00:44:15,983 adding 'lm_eval/tasks/include/default/Polish/_polish_template_yaml' 2025-11-27T00:44:15,984 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml' 2025-11-27T00:44:15,985 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml' 2025-11-27T00:44:15,986 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml' 2025-11-27T00:44:15,987 adding 'lm_eval/tasks/include/default/Polish/utils.py' 2025-11-27T00:44:15,989 adding 'lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml' 2025-11-27T00:44:15,990 adding 'lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml' 2025-11-27T00:44:15,992 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml' 2025-11-27T00:44:15,993 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2025-11-27T00:44:15,994 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2025-11-27T00:44:15,995 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2025-11-27T00:44:15,996 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml' 2025-11-27T00:44:15,997 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml' 2025-11-27T00:44:15,999 adding 'lm_eval/tasks/include/default/Portuguese/utils.py' 2025-11-27T00:44:16,001 adding 'lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml' 2025-11-27T00:44:16,002 adding 'lm_eval/tasks/include/default/Russian/_russian_template_yaml' 2025-11-27T00:44:16,004 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml' 2025-11-27T00:44:16,005 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml' 2025-11-27T00:44:16,007 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml' 2025-11-27T00:44:16,009 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml' 2025-11-27T00:44:16,010 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml' 2025-11-27T00:44:16,011 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml' 2025-11-27T00:44:16,012 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml' 2025-11-27T00:44:16,014 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml' 2025-11-27T00:44:16,015 adding 'lm_eval/tasks/include/default/Russian/utils.py' 2025-11-27T00:44:16,017 adding 'lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml' 2025-11-27T00:44:16,018 adding 'lm_eval/tasks/include/default/Serbian/_serbian_template_yaml' 2025-11-27T00:44:16,019 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml' 2025-11-27T00:44:16,020 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml' 2025-11-27T00:44:16,022 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml' 2025-11-27T00:44:16,023 adding 'lm_eval/tasks/include/default/Serbian/utils.py' 2025-11-27T00:44:16,025 adding 'lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml' 2025-11-27T00:44:16,026 adding 'lm_eval/tasks/include/default/Spanish/_spanish_template_yaml' 2025-11-27T00:44:16,027 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml' 2025-11-27T00:44:16,028 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2025-11-27T00:44:16,029 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml' 2025-11-27T00:44:16,031 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml' 2025-11-27T00:44:16,032 adding 'lm_eval/tasks/include/default/Spanish/utils.py' 2025-11-27T00:44:16,034 adding 'lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml' 2025-11-27T00:44:16,035 adding 'lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml' 2025-11-27T00:44:16,036 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2025-11-27T00:44:16,037 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml' 2025-11-27T00:44:16,038 adding 'lm_eval/tasks/include/default/Tagalog/utils.py' 2025-11-27T00:44:16,040 adding 'lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml' 2025-11-27T00:44:16,041 adding 'lm_eval/tasks/include/default/Tamil/_tamil_template_yaml' 2025-11-27T00:44:16,043 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml' 2025-11-27T00:44:16,044 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml' 2025-11-27T00:44:16,046 adding 'lm_eval/tasks/include/default/Tamil/utils.py' 2025-11-27T00:44:16,048 adding 'lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml' 2025-11-27T00:44:16,049 adding 'lm_eval/tasks/include/default/Telugu/_telugu_template_yaml' 2025-11-27T00:44:16,050 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml' 2025-11-27T00:44:16,052 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml' 2025-11-27T00:44:16,054 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml' 2025-11-27T00:44:16,055 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml' 2025-11-27T00:44:16,056 adding 'lm_eval/tasks/include/default/Telugu/utils.py' 2025-11-27T00:44:16,058 adding 'lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml' 2025-11-27T00:44:16,059 adding 'lm_eval/tasks/include/default/Turkish/_turkish_template_yaml' 2025-11-27T00:44:16,061 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml' 2025-11-27T00:44:16,062 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml' 2025-11-27T00:44:16,063 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml' 2025-11-27T00:44:16,064 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml' 2025-11-27T00:44:16,065 adding 'lm_eval/tasks/include/default/Turkish/utils.py' 2025-11-27T00:44:16,067 adding 'lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml' 2025-11-27T00:44:16,068 adding 'lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml' 2025-11-27T00:44:16,070 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2025-11-27T00:44:16,071 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2025-11-27T00:44:16,072 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml' 2025-11-27T00:44:16,073 adding 'lm_eval/tasks/include/default/Ukrainian/utils.py' 2025-11-27T00:44:16,075 adding 'lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml' 2025-11-27T00:44:16,076 adding 'lm_eval/tasks/include/default/Urdu/_urdu_template_yaml' 2025-11-27T00:44:16,077 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml' 2025-11-27T00:44:16,079 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2025-11-27T00:44:16,080 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml' 2025-11-27T00:44:16,081 adding 'lm_eval/tasks/include/default/Urdu/utils.py' 2025-11-27T00:44:16,083 adding 'lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml' 2025-11-27T00:44:16,084 adding 'lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml' 2025-11-27T00:44:16,085 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2025-11-27T00:44:16,086 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml' 2025-11-27T00:44:16,088 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml' 2025-11-27T00:44:16,089 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml' 2025-11-27T00:44:16,090 adding 'lm_eval/tasks/include/default/Uzbek/utils.py' 2025-11-27T00:44:16,091 adding 'lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml' 2025-11-27T00:44:16,093 adding 'lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml' 2025-11-27T00:44:16,094 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2025-11-27T00:44:16,095 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2025-11-27T00:44:16,096 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml' 2025-11-27T00:44:16,097 adding 'lm_eval/tasks/include/default/Vietnamese/utils.py' 2025-11-27T00:44:16,100 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml' 2025-11-27T00:44:16,101 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml' 2025-11-27T00:44:16,102 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml' 2025-11-27T00:44:16,104 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml' 2025-11-27T00:44:16,105 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2025-11-27T00:44:16,106 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml' 2025-11-27T00:44:16,107 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml' 2025-11-27T00:44:16,108 adding 'lm_eval/tasks/include/few_shot_en/Albanian/utils.py' 2025-11-27T00:44:16,110 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml' 2025-11-27T00:44:16,111 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml' 2025-11-27T00:44:16,113 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml' 2025-11-27T00:44:16,114 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml' 2025-11-27T00:44:16,115 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml' 2025-11-27T00:44:16,116 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml' 2025-11-27T00:44:16,117 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml' 2025-11-27T00:44:16,119 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml' 2025-11-27T00:44:16,120 adding 'lm_eval/tasks/include/few_shot_en/Arabic/utils.py' 2025-11-27T00:44:16,122 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml' 2025-11-27T00:44:16,123 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml' 2025-11-27T00:44:16,124 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml' 2025-11-27T00:44:16,125 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml' 2025-11-27T00:44:16,127 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml' 2025-11-27T00:44:16,128 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml' 2025-11-27T00:44:16,129 adding 'lm_eval/tasks/include/few_shot_en/Armenian/utils.py' 2025-11-27T00:44:16,131 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml' 2025-11-27T00:44:16,132 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml' 2025-11-27T00:44:16,133 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2025-11-27T00:44:16,135 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2025-11-27T00:44:16,136 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2025-11-27T00:44:16,137 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2025-11-27T00:44:16,138 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2025-11-27T00:44:16,139 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2025-11-27T00:44:16,140 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py' 2025-11-27T00:44:16,142 adding 'lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml' 2025-11-27T00:44:16,143 adding 'lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml' 2025-11-27T00:44:16,144 adding 'lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml' 2025-11-27T00:44:16,146 adding 'lm_eval/tasks/include/few_shot_en/Basque/utils.py' 2025-11-27T00:44:16,147 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml' 2025-11-27T00:44:16,149 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml' 2025-11-27T00:44:16,150 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2025-11-27T00:44:16,151 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml' 2025-11-27T00:44:16,152 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml' 2025-11-27T00:44:16,153 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/utils.py' 2025-11-27T00:44:16,155 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml' 2025-11-27T00:44:16,156 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml' 2025-11-27T00:44:16,158 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml' 2025-11-27T00:44:16,159 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml' 2025-11-27T00:44:16,160 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml' 2025-11-27T00:44:16,161 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml' 2025-11-27T00:44:16,162 adding 'lm_eval/tasks/include/few_shot_en/Bengali/utils.py' 2025-11-27T00:44:16,164 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml' 2025-11-27T00:44:16,165 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml' 2025-11-27T00:44:16,167 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2025-11-27T00:44:16,168 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2025-11-27T00:44:16,169 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml' 2025-11-27T00:44:16,170 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py' 2025-11-27T00:44:16,172 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml' 2025-11-27T00:44:16,173 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml' 2025-11-27T00:44:16,175 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml' 2025-11-27T00:44:16,176 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml' 2025-11-27T00:44:16,177 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml' 2025-11-27T00:44:16,178 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml' 2025-11-27T00:44:16,179 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2025-11-27T00:44:16,180 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml' 2025-11-27T00:44:16,182 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml' 2025-11-27T00:44:16,183 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml' 2025-11-27T00:44:16,184 adding 'lm_eval/tasks/include/few_shot_en/Chinese/utils.py' 2025-11-27T00:44:16,186 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml' 2025-11-27T00:44:16,187 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml' 2025-11-27T00:44:16,188 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml' 2025-11-27T00:44:16,189 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml' 2025-11-27T00:44:16,190 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml' 2025-11-27T00:44:16,192 adding 'lm_eval/tasks/include/few_shot_en/Croatian/utils.py' 2025-11-27T00:44:16,193 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml' 2025-11-27T00:44:16,195 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml' 2025-11-27T00:44:16,196 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml' 2025-11-27T00:44:16,197 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml' 2025-11-27T00:44:16,198 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2025-11-27T00:44:16,199 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml' 2025-11-27T00:44:16,200 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml' 2025-11-27T00:44:16,201 adding 'lm_eval/tasks/include/few_shot_en/Dutch/utils.py' 2025-11-27T00:44:16,203 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml' 2025-11-27T00:44:16,205 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml' 2025-11-27T00:44:16,206 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml' 2025-11-27T00:44:16,207 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml' 2025-11-27T00:44:16,208 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2025-11-27T00:44:16,209 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml' 2025-11-27T00:44:16,210 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml' 2025-11-27T00:44:16,212 adding 'lm_eval/tasks/include/few_shot_en/Estonian/utils.py' 2025-11-27T00:44:16,214 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml' 2025-11-27T00:44:16,215 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml' 2025-11-27T00:44:16,216 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml' 2025-11-27T00:44:16,217 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml' 2025-11-27T00:44:16,218 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2025-11-27T00:44:16,220 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml' 2025-11-27T00:44:16,221 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml' 2025-11-27T00:44:16,222 adding 'lm_eval/tasks/include/few_shot_en/Finnish/utils.py' 2025-11-27T00:44:16,224 adding 'lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml' 2025-11-27T00:44:16,225 adding 'lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml' 2025-11-27T00:44:16,226 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml' 2025-11-27T00:44:16,227 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml' 2025-11-27T00:44:16,228 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml' 2025-11-27T00:44:16,229 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml' 2025-11-27T00:44:16,230 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml' 2025-11-27T00:44:16,232 adding 'lm_eval/tasks/include/few_shot_en/French/utils.py' 2025-11-27T00:44:16,233 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml' 2025-11-27T00:44:16,234 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml' 2025-11-27T00:44:16,236 adding 'lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml' 2025-11-27T00:44:16,237 adding 'lm_eval/tasks/include/few_shot_en/Georgian/utils.py' 2025-11-27T00:44:16,239 adding 'lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml' 2025-11-27T00:44:16,240 adding 'lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml' 2025-11-27T00:44:16,241 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml' 2025-11-27T00:44:16,242 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml' 2025-11-27T00:44:16,243 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml' 2025-11-27T00:44:16,245 adding 'lm_eval/tasks/include/few_shot_en/German/utils.py' 2025-11-27T00:44:16,247 adding 'lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml' 2025-11-27T00:44:16,248 adding 'lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml' 2025-11-27T00:44:16,249 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml' 2025-11-27T00:44:16,250 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml' 2025-11-27T00:44:16,251 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml' 2025-11-27T00:44:16,253 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml' 2025-11-27T00:44:16,254 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml' 2025-11-27T00:44:16,255 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml' 2025-11-27T00:44:16,256 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml' 2025-11-27T00:44:16,258 adding 'lm_eval/tasks/include/few_shot_en/Greek/utils.py' 2025-11-27T00:44:16,259 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml' 2025-11-27T00:44:16,261 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml' 2025-11-27T00:44:16,262 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2025-11-27T00:44:16,263 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml' 2025-11-27T00:44:16,264 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/utils.py' 2025-11-27T00:44:16,266 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml' 2025-11-27T00:44:16,267 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml' 2025-11-27T00:44:16,269 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml' 2025-11-27T00:44:16,270 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml' 2025-11-27T00:44:16,271 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml' 2025-11-27T00:44:16,272 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml' 2025-11-27T00:44:16,273 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2025-11-27T00:44:16,274 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml' 2025-11-27T00:44:16,275 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml' 2025-11-27T00:44:16,276 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml' 2025-11-27T00:44:16,278 adding 'lm_eval/tasks/include/few_shot_en/Hindi/utils.py' 2025-11-27T00:44:16,280 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml' 2025-11-27T00:44:16,281 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml' 2025-11-27T00:44:16,282 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml' 2025-11-27T00:44:16,283 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml' 2025-11-27T00:44:16,284 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml' 2025-11-27T00:44:16,286 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/utils.py' 2025-11-27T00:44:16,287 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml' 2025-11-27T00:44:16,288 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml' 2025-11-27T00:44:16,290 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml' 2025-11-27T00:44:16,291 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2025-11-27T00:44:16,292 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2025-11-27T00:44:16,293 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml' 2025-11-27T00:44:16,294 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml' 2025-11-27T00:44:16,296 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/utils.py' 2025-11-27T00:44:16,297 adding 'lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml' 2025-11-27T00:44:16,299 adding 'lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml' 2025-11-27T00:44:16,300 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml' 2025-11-27T00:44:16,301 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml' 2025-11-27T00:44:16,302 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml' 2025-11-27T00:44:16,303 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml' 2025-11-27T00:44:16,305 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml' 2025-11-27T00:44:16,306 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml' 2025-11-27T00:44:16,307 adding 'lm_eval/tasks/include/few_shot_en/Italian/utils.py' 2025-11-27T00:44:16,309 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml' 2025-11-27T00:44:16,310 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml' 2025-11-27T00:44:16,311 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml' 2025-11-27T00:44:16,313 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml' 2025-11-27T00:44:16,314 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml' 2025-11-27T00:44:16,315 adding 'lm_eval/tasks/include/few_shot_en/Japanese/utils.py' 2025-11-27T00:44:16,317 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml' 2025-11-27T00:44:16,318 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml' 2025-11-27T00:44:16,319 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2025-11-27T00:44:16,320 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/utils.py' 2025-11-27T00:44:16,322 adding 'lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml' 2025-11-27T00:44:16,323 adding 'lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml' 2025-11-27T00:44:16,324 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml' 2025-11-27T00:44:16,325 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml' 2025-11-27T00:44:16,327 adding 'lm_eval/tasks/include/few_shot_en/Korean/utils.py' 2025-11-27T00:44:16,328 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml' 2025-11-27T00:44:16,330 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml' 2025-11-27T00:44:16,331 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2025-11-27T00:44:16,332 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2025-11-27T00:44:16,333 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2025-11-27T00:44:16,334 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2025-11-27T00:44:16,335 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml' 2025-11-27T00:44:16,336 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py' 2025-11-27T00:44:16,338 adding 'lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml' 2025-11-27T00:44:16,340 adding 'lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml' 2025-11-27T00:44:16,341 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml' 2025-11-27T00:44:16,342 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml' 2025-11-27T00:44:16,343 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml' 2025-11-27T00:44:16,344 adding 'lm_eval/tasks/include/few_shot_en/Malay/utils.py' 2025-11-27T00:44:16,346 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml' 2025-11-27T00:44:16,348 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml' 2025-11-27T00:44:16,349 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2025-11-27T00:44:16,350 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2025-11-27T00:44:16,351 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2025-11-27T00:44:16,353 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml' 2025-11-27T00:44:16,354 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml' 2025-11-27T00:44:16,355 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml' 2025-11-27T00:44:16,356 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/utils.py' 2025-11-27T00:44:16,358 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml' 2025-11-27T00:44:16,359 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml' 2025-11-27T00:44:16,360 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml' 2025-11-27T00:44:16,362 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml' 2025-11-27T00:44:16,363 adding 'lm_eval/tasks/include/few_shot_en/Nepali/utils.py' 2025-11-27T00:44:16,365 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml' 2025-11-27T00:44:16,366 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml' 2025-11-27T00:44:16,367 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2025-11-27T00:44:16,368 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2025-11-27T00:44:16,369 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2025-11-27T00:44:16,370 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml' 2025-11-27T00:44:16,372 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py' 2025-11-27T00:44:16,373 adding 'lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml' 2025-11-27T00:44:16,374 adding 'lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml' 2025-11-27T00:44:16,376 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml' 2025-11-27T00:44:16,377 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml' 2025-11-27T00:44:16,378 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml' 2025-11-27T00:44:16,379 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml' 2025-11-27T00:44:16,380 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml' 2025-11-27T00:44:16,381 adding 'lm_eval/tasks/include/few_shot_en/Persian/utils.py' 2025-11-27T00:44:16,383 adding 'lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml' 2025-11-27T00:44:16,384 adding 'lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml' 2025-11-27T00:44:16,386 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml' 2025-11-27T00:44:16,387 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml' 2025-11-27T00:44:16,388 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml' 2025-11-27T00:44:16,389 adding 'lm_eval/tasks/include/few_shot_en/Polish/utils.py' 2025-11-27T00:44:16,391 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml' 2025-11-27T00:44:16,392 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml' 2025-11-27T00:44:16,393 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml' 2025-11-27T00:44:16,395 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2025-11-27T00:44:16,396 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2025-11-27T00:44:16,397 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2025-11-27T00:44:16,398 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml' 2025-11-27T00:44:16,399 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml' 2025-11-27T00:44:16,401 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/utils.py' 2025-11-27T00:44:16,402 adding 'lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml' 2025-11-27T00:44:16,404 adding 'lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml' 2025-11-27T00:44:16,405 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml' 2025-11-27T00:44:16,406 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml' 2025-11-27T00:44:16,407 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml' 2025-11-27T00:44:16,408 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml' 2025-11-27T00:44:16,409 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml' 2025-11-27T00:44:16,410 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml' 2025-11-27T00:44:16,412 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml' 2025-11-27T00:44:16,413 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml' 2025-11-27T00:44:16,414 adding 'lm_eval/tasks/include/few_shot_en/Russian/utils.py' 2025-11-27T00:44:16,415 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml' 2025-11-27T00:44:16,417 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml' 2025-11-27T00:44:16,418 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml' 2025-11-27T00:44:16,419 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml' 2025-11-27T00:44:16,420 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml' 2025-11-27T00:44:16,421 adding 'lm_eval/tasks/include/few_shot_en/Serbian/utils.py' 2025-11-27T00:44:16,423 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml' 2025-11-27T00:44:16,424 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml' 2025-11-27T00:44:16,425 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml' 2025-11-27T00:44:16,427 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2025-11-27T00:44:16,428 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml' 2025-11-27T00:44:16,429 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml' 2025-11-27T00:44:16,430 adding 'lm_eval/tasks/include/few_shot_en/Spanish/utils.py' 2025-11-27T00:44:16,432 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml' 2025-11-27T00:44:16,433 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml' 2025-11-27T00:44:16,434 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2025-11-27T00:44:16,436 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml' 2025-11-27T00:44:16,437 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/utils.py' 2025-11-27T00:44:16,439 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml' 2025-11-27T00:44:16,440 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml' 2025-11-27T00:44:16,441 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml' 2025-11-27T00:44:16,442 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml' 2025-11-27T00:44:16,444 adding 'lm_eval/tasks/include/few_shot_en/Tamil/utils.py' 2025-11-27T00:44:16,445 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml' 2025-11-27T00:44:16,447 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml' 2025-11-27T00:44:16,448 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml' 2025-11-27T00:44:16,449 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml' 2025-11-27T00:44:16,450 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml' 2025-11-27T00:44:16,452 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml' 2025-11-27T00:44:16,453 adding 'lm_eval/tasks/include/few_shot_en/Telugu/utils.py' 2025-11-27T00:44:16,455 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml' 2025-11-27T00:44:16,456 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml' 2025-11-27T00:44:16,457 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml' 2025-11-27T00:44:16,458 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml' 2025-11-27T00:44:16,459 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml' 2025-11-27T00:44:16,460 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml' 2025-11-27T00:44:16,461 adding 'lm_eval/tasks/include/few_shot_en/Turkish/utils.py' 2025-11-27T00:44:16,463 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml' 2025-11-27T00:44:16,464 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml' 2025-11-27T00:44:16,465 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2025-11-27T00:44:16,467 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2025-11-27T00:44:16,468 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml' 2025-11-27T00:44:16,469 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py' 2025-11-27T00:44:16,471 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml' 2025-11-27T00:44:16,472 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml' 2025-11-27T00:44:16,473 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml' 2025-11-27T00:44:16,474 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2025-11-27T00:44:16,475 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml' 2025-11-27T00:44:16,477 adding 'lm_eval/tasks/include/few_shot_en/Urdu/utils.py' 2025-11-27T00:44:16,478 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml' 2025-11-27T00:44:16,480 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml' 2025-11-27T00:44:16,481 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2025-11-27T00:44:16,482 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml' 2025-11-27T00:44:16,483 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml' 2025-11-27T00:44:16,484 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml' 2025-11-27T00:44:16,486 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/utils.py' 2025-11-27T00:44:16,487 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml' 2025-11-27T00:44:16,489 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml' 2025-11-27T00:44:16,490 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2025-11-27T00:44:16,491 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2025-11-27T00:44:16,492 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml' 2025-11-27T00:44:16,493 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py' 2025-11-27T00:44:16,496 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml' 2025-11-27T00:44:16,497 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml' 2025-11-27T00:44:16,499 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml' 2025-11-27T00:44:16,500 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml' 2025-11-27T00:44:16,501 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2025-11-27T00:44:16,502 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml' 2025-11-27T00:44:16,503 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml' 2025-11-27T00:44:16,504 adding 'lm_eval/tasks/include/few_shot_og/Albanian/utils.py' 2025-11-27T00:44:16,506 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml' 2025-11-27T00:44:16,507 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml' 2025-11-27T00:44:16,509 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml' 2025-11-27T00:44:16,510 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml' 2025-11-27T00:44:16,511 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml' 2025-11-27T00:44:16,512 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml' 2025-11-27T00:44:16,513 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml' 2025-11-27T00:44:16,514 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml' 2025-11-27T00:44:16,516 adding 'lm_eval/tasks/include/few_shot_og/Arabic/utils.py' 2025-11-27T00:44:16,517 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml' 2025-11-27T00:44:16,519 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml' 2025-11-27T00:44:16,520 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml' 2025-11-27T00:44:16,521 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml' 2025-11-27T00:44:16,522 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml' 2025-11-27T00:44:16,523 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml' 2025-11-27T00:44:16,525 adding 'lm_eval/tasks/include/few_shot_og/Armenian/utils.py' 2025-11-27T00:44:16,526 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml' 2025-11-27T00:44:16,528 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml' 2025-11-27T00:44:16,529 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2025-11-27T00:44:16,530 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2025-11-27T00:44:16,531 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2025-11-27T00:44:16,533 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2025-11-27T00:44:16,534 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2025-11-27T00:44:16,535 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2025-11-27T00:44:16,536 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py' 2025-11-27T00:44:16,538 adding 'lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml' 2025-11-27T00:44:16,539 adding 'lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml' 2025-11-27T00:44:16,540 adding 'lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml' 2025-11-27T00:44:16,542 adding 'lm_eval/tasks/include/few_shot_og/Basque/utils.py' 2025-11-27T00:44:16,543 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml' 2025-11-27T00:44:16,545 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml' 2025-11-27T00:44:16,546 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2025-11-27T00:44:16,547 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml' 2025-11-27T00:44:16,548 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml' 2025-11-27T00:44:16,549 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/utils.py' 2025-11-27T00:44:16,551 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml' 2025-11-27T00:44:16,552 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml' 2025-11-27T00:44:16,553 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml' 2025-11-27T00:44:16,554 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml' 2025-11-27T00:44:16,555 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml' 2025-11-27T00:44:16,556 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml' 2025-11-27T00:44:16,558 adding 'lm_eval/tasks/include/few_shot_og/Bengali/utils.py' 2025-11-27T00:44:16,559 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml' 2025-11-27T00:44:16,561 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml' 2025-11-27T00:44:16,562 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2025-11-27T00:44:16,563 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2025-11-27T00:44:16,564 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml' 2025-11-27T00:44:16,565 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py' 2025-11-27T00:44:16,567 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml' 2025-11-27T00:44:16,568 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml' 2025-11-27T00:44:16,569 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml' 2025-11-27T00:44:16,571 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml' 2025-11-27T00:44:16,572 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml' 2025-11-27T00:44:16,573 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml' 2025-11-27T00:44:16,574 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2025-11-27T00:44:16,575 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml' 2025-11-27T00:44:16,577 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml' 2025-11-27T00:44:16,578 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml' 2025-11-27T00:44:16,579 adding 'lm_eval/tasks/include/few_shot_og/Chinese/utils.py' 2025-11-27T00:44:16,581 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml' 2025-11-27T00:44:16,582 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml' 2025-11-27T00:44:16,583 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml' 2025-11-27T00:44:16,584 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml' 2025-11-27T00:44:16,585 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml' 2025-11-27T00:44:16,587 adding 'lm_eval/tasks/include/few_shot_og/Croatian/utils.py' 2025-11-27T00:44:16,589 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml' 2025-11-27T00:44:16,590 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml' 2025-11-27T00:44:16,591 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml' 2025-11-27T00:44:16,592 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml' 2025-11-27T00:44:16,593 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2025-11-27T00:44:16,594 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml' 2025-11-27T00:44:16,595 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml' 2025-11-27T00:44:16,596 adding 'lm_eval/tasks/include/few_shot_og/Dutch/utils.py' 2025-11-27T00:44:16,598 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml' 2025-11-27T00:44:16,599 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml' 2025-11-27T00:44:16,600 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml' 2025-11-27T00:44:16,601 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml' 2025-11-27T00:44:16,602 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2025-11-27T00:44:16,604 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml' 2025-11-27T00:44:16,605 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml' 2025-11-27T00:44:16,606 adding 'lm_eval/tasks/include/few_shot_og/Estonian/utils.py' 2025-11-27T00:44:16,608 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml' 2025-11-27T00:44:16,609 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml' 2025-11-27T00:44:16,610 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml' 2025-11-27T00:44:16,611 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml' 2025-11-27T00:44:16,612 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2025-11-27T00:44:16,613 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml' 2025-11-27T00:44:16,614 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml' 2025-11-27T00:44:16,616 adding 'lm_eval/tasks/include/few_shot_og/Finnish/utils.py' 2025-11-27T00:44:16,618 adding 'lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml' 2025-11-27T00:44:16,619 adding 'lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml' 2025-11-27T00:44:16,620 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml' 2025-11-27T00:44:16,621 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml' 2025-11-27T00:44:16,622 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml' 2025-11-27T00:44:16,623 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml' 2025-11-27T00:44:16,625 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml' 2025-11-27T00:44:16,626 adding 'lm_eval/tasks/include/few_shot_og/French/utils.py' 2025-11-27T00:44:16,628 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml' 2025-11-27T00:44:16,629 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml' 2025-11-27T00:44:16,630 adding 'lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml' 2025-11-27T00:44:16,631 adding 'lm_eval/tasks/include/few_shot_og/Georgian/utils.py' 2025-11-27T00:44:16,633 adding 'lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml' 2025-11-27T00:44:16,634 adding 'lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml' 2025-11-27T00:44:16,636 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml' 2025-11-27T00:44:16,637 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml' 2025-11-27T00:44:16,638 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml' 2025-11-27T00:44:16,639 adding 'lm_eval/tasks/include/few_shot_og/German/utils.py' 2025-11-27T00:44:16,641 adding 'lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml' 2025-11-27T00:44:16,642 adding 'lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml' 2025-11-27T00:44:16,643 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml' 2025-11-27T00:44:16,644 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml' 2025-11-27T00:44:16,645 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml' 2025-11-27T00:44:16,646 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml' 2025-11-27T00:44:16,648 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml' 2025-11-27T00:44:16,649 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml' 2025-11-27T00:44:16,650 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml' 2025-11-27T00:44:16,651 adding 'lm_eval/tasks/include/few_shot_og/Greek/utils.py' 2025-11-27T00:44:16,653 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml' 2025-11-27T00:44:16,654 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml' 2025-11-27T00:44:16,656 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2025-11-27T00:44:16,657 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml' 2025-11-27T00:44:16,658 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/utils.py' 2025-11-27T00:44:16,660 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml' 2025-11-27T00:44:16,661 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml' 2025-11-27T00:44:16,662 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml' 2025-11-27T00:44:16,664 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml' 2025-11-27T00:44:16,665 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml' 2025-11-27T00:44:16,666 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml' 2025-11-27T00:44:16,667 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2025-11-27T00:44:16,669 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml' 2025-11-27T00:44:16,670 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml' 2025-11-27T00:44:16,671 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml' 2025-11-27T00:44:16,672 adding 'lm_eval/tasks/include/few_shot_og/Hindi/utils.py' 2025-11-27T00:44:16,674 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml' 2025-11-27T00:44:16,675 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml' 2025-11-27T00:44:16,677 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml' 2025-11-27T00:44:16,678 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml' 2025-11-27T00:44:16,679 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml' 2025-11-27T00:44:16,680 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/utils.py' 2025-11-27T00:44:16,682 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml' 2025-11-27T00:44:16,684 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml' 2025-11-27T00:44:16,685 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml' 2025-11-27T00:44:16,686 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2025-11-27T00:44:16,687 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2025-11-27T00:44:16,688 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml' 2025-11-27T00:44:16,689 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml' 2025-11-27T00:44:16,690 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/utils.py' 2025-11-27T00:44:16,692 adding 'lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml' 2025-11-27T00:44:16,694 adding 'lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml' 2025-11-27T00:44:16,695 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml' 2025-11-27T00:44:16,696 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml' 2025-11-27T00:44:16,697 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml' 2025-11-27T00:44:16,699 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml' 2025-11-27T00:44:16,700 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml' 2025-11-27T00:44:16,701 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml' 2025-11-27T00:44:16,702 adding 'lm_eval/tasks/include/few_shot_og/Italian/utils.py' 2025-11-27T00:44:16,704 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml' 2025-11-27T00:44:16,706 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml' 2025-11-27T00:44:16,707 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml' 2025-11-27T00:44:16,708 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml' 2025-11-27T00:44:16,709 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml' 2025-11-27T00:44:16,711 adding 'lm_eval/tasks/include/few_shot_og/Japanese/utils.py' 2025-11-27T00:44:16,712 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml' 2025-11-27T00:44:16,714 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml' 2025-11-27T00:44:16,715 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2025-11-27T00:44:16,716 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/utils.py' 2025-11-27T00:44:16,718 adding 'lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml' 2025-11-27T00:44:16,719 adding 'lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml' 2025-11-27T00:44:16,720 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml' 2025-11-27T00:44:16,722 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml' 2025-11-27T00:44:16,723 adding 'lm_eval/tasks/include/few_shot_og/Korean/utils.py' 2025-11-27T00:44:16,725 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml' 2025-11-27T00:44:16,726 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml' 2025-11-27T00:44:16,727 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2025-11-27T00:44:16,728 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2025-11-27T00:44:16,730 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2025-11-27T00:44:16,731 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2025-11-27T00:44:16,732 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml' 2025-11-27T00:44:16,733 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py' 2025-11-27T00:44:16,735 adding 'lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml' 2025-11-27T00:44:16,736 adding 'lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml' 2025-11-27T00:44:16,737 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml' 2025-11-27T00:44:16,738 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml' 2025-11-27T00:44:16,739 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml' 2025-11-27T00:44:16,740 adding 'lm_eval/tasks/include/few_shot_og/Malay/utils.py' 2025-11-27T00:44:16,742 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml' 2025-11-27T00:44:16,744 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml' 2025-11-27T00:44:16,745 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2025-11-27T00:44:16,746 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2025-11-27T00:44:16,747 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2025-11-27T00:44:16,748 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml' 2025-11-27T00:44:16,749 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml' 2025-11-27T00:44:16,750 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml' 2025-11-27T00:44:16,752 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/utils.py' 2025-11-27T00:44:16,754 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml' 2025-11-27T00:44:16,755 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml' 2025-11-27T00:44:16,756 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml' 2025-11-27T00:44:16,757 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml' 2025-11-27T00:44:16,758 adding 'lm_eval/tasks/include/few_shot_og/Nepali/utils.py' 2025-11-27T00:44:16,760 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml' 2025-11-27T00:44:16,761 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml' 2025-11-27T00:44:16,763 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2025-11-27T00:44:16,764 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2025-11-27T00:44:16,765 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2025-11-27T00:44:16,766 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml' 2025-11-27T00:44:16,767 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py' 2025-11-27T00:44:16,769 adding 'lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml' 2025-11-27T00:44:16,770 adding 'lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml' 2025-11-27T00:44:16,772 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml' 2025-11-27T00:44:16,773 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml' 2025-11-27T00:44:16,774 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml' 2025-11-27T00:44:16,775 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml' 2025-11-27T00:44:16,777 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml' 2025-11-27T00:44:16,778 adding 'lm_eval/tasks/include/few_shot_og/Persian/utils.py' 2025-11-27T00:44:16,780 adding 'lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml' 2025-11-27T00:44:16,781 adding 'lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml' 2025-11-27T00:44:16,782 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml' 2025-11-27T00:44:16,783 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml' 2025-11-27T00:44:16,784 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml' 2025-11-27T00:44:16,785 adding 'lm_eval/tasks/include/few_shot_og/Polish/utils.py' 2025-11-27T00:44:16,787 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml' 2025-11-27T00:44:16,788 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml' 2025-11-27T00:44:16,789 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml' 2025-11-27T00:44:16,791 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2025-11-27T00:44:16,792 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2025-11-27T00:44:16,793 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2025-11-27T00:44:16,794 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml' 2025-11-27T00:44:16,795 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml' 2025-11-27T00:44:16,796 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/utils.py' 2025-11-27T00:44:16,798 adding 'lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml' 2025-11-27T00:44:16,800 adding 'lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml' 2025-11-27T00:44:16,801 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml' 2025-11-27T00:44:16,802 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml' 2025-11-27T00:44:16,803 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml' 2025-11-27T00:44:16,804 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml' 2025-11-27T00:44:16,805 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml' 2025-11-27T00:44:16,807 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml' 2025-11-27T00:44:16,808 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml' 2025-11-27T00:44:16,809 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml' 2025-11-27T00:44:16,810 adding 'lm_eval/tasks/include/few_shot_og/Russian/utils.py' 2025-11-27T00:44:16,812 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml' 2025-11-27T00:44:16,813 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml' 2025-11-27T00:44:16,815 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml' 2025-11-27T00:44:16,816 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml' 2025-11-27T00:44:16,817 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml' 2025-11-27T00:44:16,818 adding 'lm_eval/tasks/include/few_shot_og/Serbian/utils.py' 2025-11-27T00:44:16,820 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml' 2025-11-27T00:44:16,821 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml' 2025-11-27T00:44:16,823 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml' 2025-11-27T00:44:16,824 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2025-11-27T00:44:16,825 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml' 2025-11-27T00:44:16,826 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml' 2025-11-27T00:44:16,827 adding 'lm_eval/tasks/include/few_shot_og/Spanish/utils.py' 2025-11-27T00:44:16,829 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml' 2025-11-27T00:44:16,830 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml' 2025-11-27T00:44:16,831 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2025-11-27T00:44:16,833 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml' 2025-11-27T00:44:16,834 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/utils.py' 2025-11-27T00:44:16,835 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml' 2025-11-27T00:44:16,837 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml' 2025-11-27T00:44:16,838 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml' 2025-11-27T00:44:16,839 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml' 2025-11-27T00:44:16,840 adding 'lm_eval/tasks/include/few_shot_og/Tamil/utils.py' 2025-11-27T00:44:16,842 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml' 2025-11-27T00:44:16,843 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml' 2025-11-27T00:44:16,844 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml' 2025-11-27T00:44:16,846 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml' 2025-11-27T00:44:16,847 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml' 2025-11-27T00:44:16,848 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml' 2025-11-27T00:44:16,849 adding 'lm_eval/tasks/include/few_shot_og/Telugu/utils.py' 2025-11-27T00:44:16,851 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml' 2025-11-27T00:44:16,852 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml' 2025-11-27T00:44:16,854 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml' 2025-11-27T00:44:16,855 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml' 2025-11-27T00:44:16,856 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml' 2025-11-27T00:44:16,857 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml' 2025-11-27T00:44:16,859 adding 'lm_eval/tasks/include/few_shot_og/Turkish/utils.py' 2025-11-27T00:44:16,860 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml' 2025-11-27T00:44:16,862 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml' 2025-11-27T00:44:16,863 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2025-11-27T00:44:16,864 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2025-11-27T00:44:16,865 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml' 2025-11-27T00:44:16,867 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py' 2025-11-27T00:44:16,868 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml' 2025-11-27T00:44:16,870 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml' 2025-11-27T00:44:16,871 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml' 2025-11-27T00:44:16,872 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2025-11-27T00:44:16,873 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml' 2025-11-27T00:44:16,874 adding 'lm_eval/tasks/include/few_shot_og/Urdu/utils.py' 2025-11-27T00:44:16,876 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml' 2025-11-27T00:44:16,877 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml' 2025-11-27T00:44:16,878 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2025-11-27T00:44:16,879 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml' 2025-11-27T00:44:16,881 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml' 2025-11-27T00:44:16,882 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml' 2025-11-27T00:44:16,883 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/utils.py' 2025-11-27T00:44:16,885 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml' 2025-11-27T00:44:16,886 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml' 2025-11-27T00:44:16,887 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2025-11-27T00:44:16,888 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2025-11-27T00:44:16,889 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml' 2025-11-27T00:44:16,891 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py' 2025-11-27T00:44:16,893 adding 'lm_eval/tasks/inverse_scaling/README.md' 2025-11-27T00:44:16,894 adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml' 2025-11-27T00:44:16,895 adding 'lm_eval/tasks/inverse_scaling/_some_results' 2025-11-27T00:44:16,897 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml' 2025-11-27T00:44:16,898 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml' 2025-11-27T00:44:16,899 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml' 2025-11-27T00:44:16,900 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml' 2025-11-27T00:44:16,901 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml' 2025-11-27T00:44:16,902 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml' 2025-11-27T00:44:16,903 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml' 2025-11-27T00:44:16,905 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml' 2025-11-27T00:44:16,906 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml' 2025-11-27T00:44:16,907 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml' 2025-11-27T00:44:16,908 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml' 2025-11-27T00:44:16,911 adding 'lm_eval/tasks/japanese_leaderboard/README.md' 2025-11-27T00:44:16,912 adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml' 2025-11-27T00:44:16,913 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml' 2025-11-27T00:44:16,914 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py' 2025-11-27T00:44:16,916 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml' 2025-11-27T00:44:16,917 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml' 2025-11-27T00:44:16,918 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml' 2025-11-27T00:44:16,920 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml' 2025-11-27T00:44:16,921 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py' 2025-11-27T00:44:16,922 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml' 2025-11-27T00:44:16,923 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py' 2025-11-27T00:44:16,925 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml' 2025-11-27T00:44:16,926 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py' 2025-11-27T00:44:16,927 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml' 2025-11-27T00:44:16,928 adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt' 2025-11-27T00:44:16,930 adding 'lm_eval/tasks/jsonschema_bench/README.md' 2025-11-27T00:44:16,932 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml' 2025-11-27T00:44:16,933 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml' 2025-11-27T00:44:16,935 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml' 2025-11-27T00:44:16,936 adding 'lm_eval/tasks/jsonschema_bench/metrics.py' 2025-11-27T00:44:16,938 adding 'lm_eval/tasks/kbl/README.md' 2025-11-27T00:44:16,941 adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml' 2025-11-27T00:44:16,942 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml' 2025-11-27T00:44:16,943 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml' 2025-11-27T00:44:16,944 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml' 2025-11-27T00:44:16,945 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml' 2025-11-27T00:44:16,946 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml' 2025-11-27T00:44:16,948 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml' 2025-11-27T00:44:16,949 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml' 2025-11-27T00:44:16,950 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml' 2025-11-27T00:44:16,951 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml' 2025-11-27T00:44:16,952 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml' 2025-11-27T00:44:16,953 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml' 2025-11-27T00:44:16,954 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml' 2025-11-27T00:44:16,956 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml' 2025-11-27T00:44:16,957 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml' 2025-11-27T00:44:16,959 adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml' 2025-11-27T00:44:16,960 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml' 2025-11-27T00:44:16,961 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml' 2025-11-27T00:44:16,962 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml' 2025-11-27T00:44:16,964 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml' 2025-11-27T00:44:16,965 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml' 2025-11-27T00:44:16,966 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml' 2025-11-27T00:44:16,967 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml' 2025-11-27T00:44:16,968 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml' 2025-11-27T00:44:16,969 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml' 2025-11-27T00:44:16,971 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml' 2025-11-27T00:44:16,972 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml' 2025-11-27T00:44:16,973 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml' 2025-11-27T00:44:16,974 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml' 2025-11-27T00:44:16,976 adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml' 2025-11-27T00:44:16,977 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml' 2025-11-27T00:44:16,978 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml' 2025-11-27T00:44:16,979 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml' 2025-11-27T00:44:16,981 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml' 2025-11-27T00:44:16,982 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml' 2025-11-27T00:44:16,983 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml' 2025-11-27T00:44:16,984 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml' 2025-11-27T00:44:16,985 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml' 2025-11-27T00:44:16,986 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml' 2025-11-27T00:44:16,987 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml' 2025-11-27T00:44:16,989 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml' 2025-11-27T00:44:16,990 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml' 2025-11-27T00:44:16,991 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml' 2025-11-27T00:44:16,993 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml' 2025-11-27T00:44:16,994 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml' 2025-11-27T00:44:16,995 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml' 2025-11-27T00:44:16,996 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml' 2025-11-27T00:44:16,997 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml' 2025-11-27T00:44:16,998 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml' 2025-11-27T00:44:17,000 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml' 2025-11-27T00:44:17,001 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml' 2025-11-27T00:44:17,002 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml' 2025-11-27T00:44:17,003 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml' 2025-11-27T00:44:17,004 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml' 2025-11-27T00:44:17,005 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml' 2025-11-27T00:44:17,007 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml' 2025-11-27T00:44:17,008 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml' 2025-11-27T00:44:17,009 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml' 2025-11-27T00:44:17,011 adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml' 2025-11-27T00:44:17,012 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml' 2025-11-27T00:44:17,013 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml' 2025-11-27T00:44:17,014 adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml' 2025-11-27T00:44:17,016 adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml' 2025-11-27T00:44:17,017 adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml' 2025-11-27T00:44:17,018 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml' 2025-11-27T00:44:17,019 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml' 2025-11-27T00:44:17,021 adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml' 2025-11-27T00:44:17,022 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml' 2025-11-27T00:44:17,024 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml' 2025-11-27T00:44:17,025 adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml' 2025-11-27T00:44:17,026 adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml' 2025-11-27T00:44:17,028 adding 'lm_eval/tasks/kmmlu/README.md' 2025-11-27T00:44:17,031 adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml' 2025-11-27T00:44:17,032 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml' 2025-11-27T00:44:17,033 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml' 2025-11-27T00:44:17,034 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml' 2025-11-27T00:44:17,035 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml' 2025-11-27T00:44:17,036 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml' 2025-11-27T00:44:17,038 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml' 2025-11-27T00:44:17,040 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml' 2025-11-27T00:44:17,042 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml' 2025-11-27T00:44:17,044 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml' 2025-11-27T00:44:17,046 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml' 2025-11-27T00:44:17,048 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml' 2025-11-27T00:44:17,050 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml' 2025-11-27T00:44:17,052 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml' 2025-11-27T00:44:17,054 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml' 2025-11-27T00:44:17,056 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml' 2025-11-27T00:44:17,058 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml' 2025-11-27T00:44:17,060 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml' 2025-11-27T00:44:17,062 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml' 2025-11-27T00:44:17,064 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml' 2025-11-27T00:44:17,066 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml' 2025-11-27T00:44:17,068 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml' 2025-11-27T00:44:17,069 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml' 2025-11-27T00:44:17,071 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml' 2025-11-27T00:44:17,073 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml' 2025-11-27T00:44:17,075 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml' 2025-11-27T00:44:17,077 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml' 2025-11-27T00:44:17,079 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml' 2025-11-27T00:44:17,081 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml' 2025-11-27T00:44:17,083 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml' 2025-11-27T00:44:17,085 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml' 2025-11-27T00:44:17,087 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml' 2025-11-27T00:44:17,089 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml' 2025-11-27T00:44:17,091 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml' 2025-11-27T00:44:17,093 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml' 2025-11-27T00:44:17,095 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml' 2025-11-27T00:44:17,097 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml' 2025-11-27T00:44:17,099 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml' 2025-11-27T00:44:17,101 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml' 2025-11-27T00:44:17,103 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml' 2025-11-27T00:44:17,105 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml' 2025-11-27T00:44:17,107 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml' 2025-11-27T00:44:17,109 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml' 2025-11-27T00:44:17,111 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml' 2025-11-27T00:44:17,113 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml' 2025-11-27T00:44:17,115 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml' 2025-11-27T00:44:17,117 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml' 2025-11-27T00:44:17,119 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml' 2025-11-27T00:44:17,121 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml' 2025-11-27T00:44:17,123 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml' 2025-11-27T00:44:17,125 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml' 2025-11-27T00:44:17,128 adding 'lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml' 2025-11-27T00:44:17,129 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml' 2025-11-27T00:44:17,130 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml' 2025-11-27T00:44:17,131 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml' 2025-11-27T00:44:17,132 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml' 2025-11-27T00:44:17,134 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml' 2025-11-27T00:44:17,135 adding 'lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml' 2025-11-27T00:44:17,136 adding 'lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml' 2025-11-27T00:44:17,137 adding 'lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml' 2025-11-27T00:44:17,138 adding 'lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml' 2025-11-27T00:44:17,139 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml' 2025-11-27T00:44:17,140 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml' 2025-11-27T00:44:17,142 adding 'lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml' 2025-11-27T00:44:17,143 adding 'lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml' 2025-11-27T00:44:17,144 adding 'lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml' 2025-11-27T00:44:17,145 adding 'lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml' 2025-11-27T00:44:17,146 adding 'lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml' 2025-11-27T00:44:17,147 adding 'lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml' 2025-11-27T00:44:17,149 adding 'lm_eval/tasks/kmmlu/default/kmmlu_education.yaml' 2025-11-27T00:44:17,150 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml' 2025-11-27T00:44:17,151 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml' 2025-11-27T00:44:17,152 adding 'lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml' 2025-11-27T00:44:17,153 adding 'lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml' 2025-11-27T00:44:17,154 adding 'lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml' 2025-11-27T00:44:17,156 adding 'lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml' 2025-11-27T00:44:17,157 adding 'lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml' 2025-11-27T00:44:17,158 adding 'lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml' 2025-11-27T00:44:17,159 adding 'lm_eval/tasks/kmmlu/default/kmmlu_health.yaml' 2025-11-27T00:44:17,161 adding 'lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml' 2025-11-27T00:44:17,162 adding 'lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml' 2025-11-27T00:44:17,163 adding 'lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml' 2025-11-27T00:44:17,164 adding 'lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml' 2025-11-27T00:44:17,166 adding 'lm_eval/tasks/kmmlu/default/kmmlu_law.yaml' 2025-11-27T00:44:17,168 adding 'lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml' 2025-11-27T00:44:17,169 adding 'lm_eval/tasks/kmmlu/default/kmmlu_management.yaml' 2025-11-27T00:44:17,170 adding 'lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml' 2025-11-27T00:44:17,171 adding 'lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml' 2025-11-27T00:44:17,172 adding 'lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml' 2025-11-27T00:44:17,173 adding 'lm_eval/tasks/kmmlu/default/kmmlu_math.yaml' 2025-11-27T00:44:17,174 adding 'lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml' 2025-11-27T00:44:17,176 adding 'lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml' 2025-11-27T00:44:17,177 adding 'lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml' 2025-11-27T00:44:17,178 adding 'lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml' 2025-11-27T00:44:17,179 adding 'lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml' 2025-11-27T00:44:17,180 adding 'lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml' 2025-11-27T00:44:17,181 adding 'lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml' 2025-11-27T00:44:17,182 adding 'lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml' 2025-11-27T00:44:17,183 adding 'lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml' 2025-11-27T00:44:17,184 adding 'lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml' 2025-11-27T00:44:17,186 adding 'lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml' 2025-11-27T00:44:17,187 adding 'lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml' 2025-11-27T00:44:17,190 adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml' 2025-11-27T00:44:17,191 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml' 2025-11-27T00:44:17,192 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml' 2025-11-27T00:44:17,193 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml' 2025-11-27T00:44:17,194 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml' 2025-11-27T00:44:17,195 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml' 2025-11-27T00:44:17,196 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml' 2025-11-27T00:44:17,198 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml' 2025-11-27T00:44:17,199 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml' 2025-11-27T00:44:17,201 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml' 2025-11-27T00:44:17,202 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml' 2025-11-27T00:44:17,203 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml' 2025-11-27T00:44:17,205 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml' 2025-11-27T00:44:17,206 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml' 2025-11-27T00:44:17,208 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml' 2025-11-27T00:44:17,210 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml' 2025-11-27T00:44:17,211 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml' 2025-11-27T00:44:17,212 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml' 2025-11-27T00:44:17,213 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml' 2025-11-27T00:44:17,214 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml' 2025-11-27T00:44:17,216 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml' 2025-11-27T00:44:17,217 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml' 2025-11-27T00:44:17,218 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml' 2025-11-27T00:44:17,219 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml' 2025-11-27T00:44:17,220 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml' 2025-11-27T00:44:17,221 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml' 2025-11-27T00:44:17,222 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml' 2025-11-27T00:44:17,223 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml' 2025-11-27T00:44:17,224 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml' 2025-11-27T00:44:17,226 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml' 2025-11-27T00:44:17,227 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml' 2025-11-27T00:44:17,228 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml' 2025-11-27T00:44:17,229 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml' 2025-11-27T00:44:17,230 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml' 2025-11-27T00:44:17,232 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml' 2025-11-27T00:44:17,233 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml' 2025-11-27T00:44:17,234 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml' 2025-11-27T00:44:17,235 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml' 2025-11-27T00:44:17,236 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml' 2025-11-27T00:44:17,237 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml' 2025-11-27T00:44:17,238 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml' 2025-11-27T00:44:17,240 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml' 2025-11-27T00:44:17,241 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml' 2025-11-27T00:44:17,242 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml' 2025-11-27T00:44:17,244 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml' 2025-11-27T00:44:17,245 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml' 2025-11-27T00:44:17,246 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml' 2025-11-27T00:44:17,248 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml' 2025-11-27T00:44:17,249 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml' 2025-11-27T00:44:17,251 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml' 2025-11-27T00:44:17,252 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml' 2025-11-27T00:44:17,255 adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml' 2025-11-27T00:44:17,257 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml' 2025-11-27T00:44:17,258 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml' 2025-11-27T00:44:17,259 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml' 2025-11-27T00:44:17,261 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml' 2025-11-27T00:44:17,262 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml' 2025-11-27T00:44:17,263 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml' 2025-11-27T00:44:17,264 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml' 2025-11-27T00:44:17,265 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml' 2025-11-27T00:44:17,266 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml' 2025-11-27T00:44:17,268 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml' 2025-11-27T00:44:17,269 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml' 2025-11-27T00:44:17,270 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml' 2025-11-27T00:44:17,271 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml' 2025-11-27T00:44:17,272 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml' 2025-11-27T00:44:17,273 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml' 2025-11-27T00:44:17,274 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml' 2025-11-27T00:44:17,275 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml' 2025-11-27T00:44:17,276 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml' 2025-11-27T00:44:17,278 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml' 2025-11-27T00:44:17,279 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml' 2025-11-27T00:44:17,280 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml' 2025-11-27T00:44:17,281 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml' 2025-11-27T00:44:17,282 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml' 2025-11-27T00:44:17,283 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml' 2025-11-27T00:44:17,284 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml' 2025-11-27T00:44:17,285 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml' 2025-11-27T00:44:17,287 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml' 2025-11-27T00:44:17,288 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml' 2025-11-27T00:44:17,289 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml' 2025-11-27T00:44:17,290 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml' 2025-11-27T00:44:17,291 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml' 2025-11-27T00:44:17,292 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml' 2025-11-27T00:44:17,293 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml' 2025-11-27T00:44:17,295 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml' 2025-11-27T00:44:17,296 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml' 2025-11-27T00:44:17,297 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml' 2025-11-27T00:44:17,298 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml' 2025-11-27T00:44:17,299 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml' 2025-11-27T00:44:17,300 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml' 2025-11-27T00:44:17,301 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml' 2025-11-27T00:44:17,303 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml' 2025-11-27T00:44:17,304 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml' 2025-11-27T00:44:17,305 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml' 2025-11-27T00:44:17,306 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml' 2025-11-27T00:44:17,307 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml' 2025-11-27T00:44:17,308 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml' 2025-11-27T00:44:17,310 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml' 2025-11-27T00:44:17,311 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml' 2025-11-27T00:44:17,312 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml' 2025-11-27T00:44:17,313 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml' 2025-11-27T00:44:17,316 adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml' 2025-11-27T00:44:17,317 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml' 2025-11-27T00:44:17,318 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml' 2025-11-27T00:44:17,319 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml' 2025-11-27T00:44:17,320 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml' 2025-11-27T00:44:17,321 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml' 2025-11-27T00:44:17,322 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml' 2025-11-27T00:44:17,323 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml' 2025-11-27T00:44:17,324 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml' 2025-11-27T00:44:17,326 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml' 2025-11-27T00:44:17,327 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml' 2025-11-27T00:44:17,328 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml' 2025-11-27T00:44:17,329 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml' 2025-11-27T00:44:17,330 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml' 2025-11-27T00:44:17,331 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml' 2025-11-27T00:44:17,332 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml' 2025-11-27T00:44:17,334 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml' 2025-11-27T00:44:17,335 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml' 2025-11-27T00:44:17,336 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml' 2025-11-27T00:44:17,337 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml' 2025-11-27T00:44:17,338 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml' 2025-11-27T00:44:17,339 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml' 2025-11-27T00:44:17,340 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml' 2025-11-27T00:44:17,341 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml' 2025-11-27T00:44:17,343 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml' 2025-11-27T00:44:17,344 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml' 2025-11-27T00:44:17,345 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml' 2025-11-27T00:44:17,346 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml' 2025-11-27T00:44:17,347 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml' 2025-11-27T00:44:17,348 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml' 2025-11-27T00:44:17,349 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml' 2025-11-27T00:44:17,351 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml' 2025-11-27T00:44:17,352 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml' 2025-11-27T00:44:17,353 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml' 2025-11-27T00:44:17,354 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml' 2025-11-27T00:44:17,355 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml' 2025-11-27T00:44:17,356 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml' 2025-11-27T00:44:17,358 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml' 2025-11-27T00:44:17,359 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml' 2025-11-27T00:44:17,360 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml' 2025-11-27T00:44:17,361 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml' 2025-11-27T00:44:17,362 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml' 2025-11-27T00:44:17,363 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml' 2025-11-27T00:44:17,365 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml' 2025-11-27T00:44:17,366 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml' 2025-11-27T00:44:17,367 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml' 2025-11-27T00:44:17,368 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml' 2025-11-27T00:44:17,369 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml' 2025-11-27T00:44:17,370 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml' 2025-11-27T00:44:17,371 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml' 2025-11-27T00:44:17,372 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml' 2025-11-27T00:44:17,374 adding 'lm_eval/tasks/kobest/README.md' 2025-11-27T00:44:17,375 adding 'lm_eval/tasks/kobest/_kobest.yaml' 2025-11-27T00:44:17,376 adding 'lm_eval/tasks/kobest/kobest_boolq.yaml' 2025-11-27T00:44:17,377 adding 'lm_eval/tasks/kobest/kobest_copa.yaml' 2025-11-27T00:44:17,379 adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml' 2025-11-27T00:44:17,380 adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml' 2025-11-27T00:44:17,381 adding 'lm_eval/tasks/kobest/kobest_wic.yaml' 2025-11-27T00:44:17,382 adding 'lm_eval/tasks/kobest/utils.py' 2025-11-27T00:44:17,384 adding 'lm_eval/tasks/kormedmcqa/README.md' 2025-11-27T00:44:17,385 adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml' 2025-11-27T00:44:17,387 adding 'lm_eval/tasks/kormedmcqa/_template_yaml' 2025-11-27T00:44:17,388 adding 'lm_eval/tasks/kormedmcqa/dentist.yaml' 2025-11-27T00:44:17,389 adding 'lm_eval/tasks/kormedmcqa/doctor.yaml' 2025-11-27T00:44:17,390 adding 'lm_eval/tasks/kormedmcqa/nurse.yaml' 2025-11-27T00:44:17,391 adding 'lm_eval/tasks/kormedmcqa/pharm.yaml' 2025-11-27T00:44:17,393 adding 'lm_eval/tasks/lambada/README.md' 2025-11-27T00:44:17,394 adding 'lm_eval/tasks/lambada/lambada_openai.yaml' 2025-11-27T00:44:17,395 adding 'lm_eval/tasks/lambada/lambada_standard.yaml' 2025-11-27T00:44:17,397 adding 'lm_eval/tasks/lambada_cloze/README.md' 2025-11-27T00:44:17,399 adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml' 2025-11-27T00:44:17,400 adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml' 2025-11-27T00:44:17,402 adding 'lm_eval/tasks/lambada_multilingual/README.md' 2025-11-27T00:44:17,403 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml' 2025-11-27T00:44:17,404 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml' 2025-11-27T00:44:17,405 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml' 2025-11-27T00:44:17,406 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml' 2025-11-27T00:44:17,407 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml' 2025-11-27T00:44:17,410 adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md' 2025-11-27T00:44:17,411 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml' 2025-11-27T00:44:17,412 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml' 2025-11-27T00:44:17,413 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml' 2025-11-27T00:44:17,414 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml' 2025-11-27T00:44:17,415 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml' 2025-11-27T00:44:17,416 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml' 2025-11-27T00:44:17,418 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml' 2025-11-27T00:44:17,421 adding 'lm_eval/tasks/leaderboard/README.md' 2025-11-27T00:44:17,422 adding 'lm_eval/tasks/leaderboard/leaderboard.yaml' 2025-11-27T00:44:17,424 adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml' 2025-11-27T00:44:17,425 adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml' 2025-11-27T00:44:17,427 adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml' 2025-11-27T00:44:17,428 adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml' 2025-11-27T00:44:17,429 adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml' 2025-11-27T00:44:17,430 adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml' 2025-11-27T00:44:17,432 adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml' 2025-11-27T00:44:17,433 adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml' 2025-11-27T00:44:17,434 adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml' 2025-11-27T00:44:17,435 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml' 2025-11-27T00:44:17,436 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml' 2025-11-27T00:44:17,438 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml' 2025-11-27T00:44:17,439 adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml' 2025-11-27T00:44:17,440 adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml' 2025-11-27T00:44:17,441 adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml' 2025-11-27T00:44:17,443 adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml' 2025-11-27T00:44:17,444 adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml' 2025-11-27T00:44:17,445 adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml' 2025-11-27T00:44:17,447 adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml' 2025-11-27T00:44:17,448 adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml' 2025-11-27T00:44:17,449 adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml' 2025-11-27T00:44:17,451 adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml' 2025-11-27T00:44:17,452 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml' 2025-11-27T00:44:17,453 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml' 2025-11-27T00:44:17,454 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml' 2025-11-27T00:44:17,456 adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml' 2025-11-27T00:44:17,457 adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml' 2025-11-27T00:44:17,459 adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml' 2025-11-27T00:44:17,460 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml' 2025-11-27T00:44:17,461 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml' 2025-11-27T00:44:17,462 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml' 2025-11-27T00:44:17,463 adding 'lm_eval/tasks/leaderboard/gpqa/utils.py' 2025-11-27T00:44:17,465 adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml' 2025-11-27T00:44:17,466 adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml' 2025-11-27T00:44:17,471 adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py' 2025-11-27T00:44:17,473 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py' 2025-11-27T00:44:17,477 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py' 2025-11-27T00:44:17,478 adding 'lm_eval/tasks/leaderboard/ifeval/utils.py' 2025-11-27T00:44:17,480 adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml' 2025-11-27T00:44:17,482 adding 'lm_eval/tasks/leaderboard/math/_template_yaml' 2025-11-27T00:44:17,483 adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml' 2025-11-27T00:44:17,484 adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml' 2025-11-27T00:44:17,485 adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml' 2025-11-27T00:44:17,486 adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml' 2025-11-27T00:44:17,488 adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml' 2025-11-27T00:44:17,489 adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml' 2025-11-27T00:44:17,490 adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml' 2025-11-27T00:44:17,492 adding 'lm_eval/tasks/leaderboard/math/utils.py' 2025-11-27T00:44:17,494 adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml' 2025-11-27T00:44:17,495 adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py' 2025-11-27T00:44:17,496 adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml' 2025-11-27T00:44:17,497 adding 'lm_eval/tasks/leaderboard/musr/_template_yaml' 2025-11-27T00:44:17,498 adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml' 2025-11-27T00:44:17,500 adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml' 2025-11-27T00:44:17,501 adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml' 2025-11-27T00:44:17,502 adding 'lm_eval/tasks/leaderboard/musr/utils.py' 2025-11-27T00:44:17,504 adding 'lm_eval/tasks/libra/README.md' 2025-11-27T00:44:17,505 adding 'lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml' 2025-11-27T00:44:17,506 adding 'lm_eval/tasks/libra/_multi_hop_question_answering.yaml' 2025-11-27T00:44:17,507 adding 'lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml' 2025-11-27T00:44:17,509 adding 'lm_eval/tasks/libra/_simple_information_retrieval.yaml' 2025-11-27T00:44:17,510 adding 'lm_eval/tasks/libra/_template_yaml' 2025-11-27T00:44:17,511 adding 'lm_eval/tasks/libra/librusec_history.yaml' 2025-11-27T00:44:17,512 adding 'lm_eval/tasks/libra/librusec_mhqa.yaml' 2025-11-27T00:44:17,514 adding 'lm_eval/tasks/libra/long_context_multiq.yaml' 2025-11-27T00:44:17,515 adding 'lm_eval/tasks/libra/matreshka_names.yaml' 2025-11-27T00:44:17,516 adding 'lm_eval/tasks/libra/matreshka_yes_no.yaml' 2025-11-27T00:44:17,517 adding 'lm_eval/tasks/libra/passkey.yaml' 2025-11-27T00:44:17,519 adding 'lm_eval/tasks/libra/passkey_with_librusec.yaml' 2025-11-27T00:44:17,520 adding 'lm_eval/tasks/libra/ru_2wikimultihopqa.yaml' 2025-11-27T00:44:17,521 adding 'lm_eval/tasks/libra/ru_babilong_qa1.yaml' 2025-11-27T00:44:17,523 adding 'lm_eval/tasks/libra/ru_babilong_qa2.yaml' 2025-11-27T00:44:17,524 adding 'lm_eval/tasks/libra/ru_babilong_qa3.yaml' 2025-11-27T00:44:17,525 adding 'lm_eval/tasks/libra/ru_babilong_qa4.yaml' 2025-11-27T00:44:17,526 adding 'lm_eval/tasks/libra/ru_babilong_qa5.yaml' 2025-11-27T00:44:17,528 adding 'lm_eval/tasks/libra/ru_gsm100.yaml' 2025-11-27T00:44:17,529 adding 'lm_eval/tasks/libra/ru_qasper.yaml' 2025-11-27T00:44:17,530 adding 'lm_eval/tasks/libra/ru_quality.yaml' 2025-11-27T00:44:17,531 adding 'lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml' 2025-11-27T00:44:17,533 adding 'lm_eval/tasks/libra/ru_sci_passage_count.yaml' 2025-11-27T00:44:17,534 adding 'lm_eval/tasks/libra/utils.py' 2025-11-27T00:44:17,536 adding 'lm_eval/tasks/lingoly/README.md' 2025-11-27T00:44:17,537 adding 'lm_eval/tasks/lingoly/lingoly_context.yaml' 2025-11-27T00:44:17,539 adding 'lm_eval/tasks/lingoly/lingoly_group.yaml' 2025-11-27T00:44:17,540 adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml' 2025-11-27T00:44:17,541 adding 'lm_eval/tasks/lingoly/script.py' 2025-11-27T00:44:17,543 adding 'lm_eval/tasks/lingoly/utils.py' 2025-11-27T00:44:17,545 adding 'lm_eval/tasks/llama3/README.md' 2025-11-27T00:44:17,547 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml' 2025-11-27T00:44:17,548 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/utils.py' 2025-11-27T00:44:17,550 adding 'lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml' 2025-11-27T00:44:17,553 adding 'lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml' 2025-11-27T00:44:17,554 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml' 2025-11-27T00:44:17,555 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml' 2025-11-27T00:44:17,557 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml' 2025-11-27T00:44:17,558 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml' 2025-11-27T00:44:17,559 adding 'lm_eval/tasks/llama3/instruct/mmlu/llama.yaml' 2025-11-27T00:44:17,560 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:17,561 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml' 2025-11-27T00:44:17,562 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml' 2025-11-27T00:44:17,563 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml' 2025-11-27T00:44:17,565 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:17,566 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml' 2025-11-27T00:44:17,567 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml' 2025-11-27T00:44:17,568 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml' 2025-11-27T00:44:17,569 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml' 2025-11-27T00:44:17,570 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml' 2025-11-27T00:44:17,571 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml' 2025-11-27T00:44:17,572 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml' 2025-11-27T00:44:17,573 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:17,575 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml' 2025-11-27T00:44:17,576 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:17,577 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:17,578 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml' 2025-11-27T00:44:17,579 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml' 2025-11-27T00:44:17,580 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml' 2025-11-27T00:44:17,581 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:17,583 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:17,584 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:17,585 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml' 2025-11-27T00:44:17,586 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:17,587 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:17,588 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:17,589 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:17,591 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml' 2025-11-27T00:44:17,592 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:17,593 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:17,594 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:17,595 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:17,596 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml' 2025-11-27T00:44:17,597 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml' 2025-11-27T00:44:17,599 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml' 2025-11-27T00:44:17,600 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml' 2025-11-27T00:44:17,601 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:17,602 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml' 2025-11-27T00:44:17,603 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml' 2025-11-27T00:44:17,604 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml' 2025-11-27T00:44:17,606 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml' 2025-11-27T00:44:17,607 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml' 2025-11-27T00:44:17,608 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml' 2025-11-27T00:44:17,609 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:17,610 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml' 2025-11-27T00:44:17,611 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml' 2025-11-27T00:44:17,613 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml' 2025-11-27T00:44:17,614 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml' 2025-11-27T00:44:17,615 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml' 2025-11-27T00:44:17,616 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml' 2025-11-27T00:44:17,617 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml' 2025-11-27T00:44:17,618 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml' 2025-11-27T00:44:17,619 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml' 2025-11-27T00:44:17,620 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml' 2025-11-27T00:44:17,622 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:17,623 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml' 2025-11-27T00:44:17,624 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml' 2025-11-27T00:44:17,627 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml' 2025-11-27T00:44:17,628 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml' 2025-11-27T00:44:17,629 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml' 2025-11-27T00:44:17,630 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml' 2025-11-27T00:44:17,631 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml' 2025-11-27T00:44:17,632 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml' 2025-11-27T00:44:17,634 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:17,635 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml' 2025-11-27T00:44:17,636 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml' 2025-11-27T00:44:17,637 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml' 2025-11-27T00:44:17,638 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:17,640 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml' 2025-11-27T00:44:17,641 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml' 2025-11-27T00:44:17,642 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml' 2025-11-27T00:44:17,643 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml' 2025-11-27T00:44:17,644 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml' 2025-11-27T00:44:17,645 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml' 2025-11-27T00:44:17,647 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml' 2025-11-27T00:44:17,648 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:17,649 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml' 2025-11-27T00:44:17,650 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:17,651 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:17,652 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml' 2025-11-27T00:44:17,654 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml' 2025-11-27T00:44:17,655 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml' 2025-11-27T00:44:17,656 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:17,657 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:17,658 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:17,659 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml' 2025-11-27T00:44:17,660 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:17,662 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:17,663 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:17,664 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:17,665 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml' 2025-11-27T00:44:17,666 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:17,667 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:17,668 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:17,669 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:17,671 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml' 2025-11-27T00:44:17,672 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml' 2025-11-27T00:44:17,673 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml' 2025-11-27T00:44:17,674 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml' 2025-11-27T00:44:17,675 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:17,676 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml' 2025-11-27T00:44:17,677 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml' 2025-11-27T00:44:17,678 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml' 2025-11-27T00:44:17,680 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml' 2025-11-27T00:44:17,681 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml' 2025-11-27T00:44:17,682 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml' 2025-11-27T00:44:17,683 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:17,684 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml' 2025-11-27T00:44:17,685 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml' 2025-11-27T00:44:17,686 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml' 2025-11-27T00:44:17,688 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml' 2025-11-27T00:44:17,689 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml' 2025-11-27T00:44:17,690 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml' 2025-11-27T00:44:17,691 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml' 2025-11-27T00:44:17,692 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml' 2025-11-27T00:44:17,693 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml' 2025-11-27T00:44:17,695 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml' 2025-11-27T00:44:17,696 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:17,697 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml' 2025-11-27T00:44:17,698 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml' 2025-11-27T00:44:17,701 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml' 2025-11-27T00:44:17,702 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml' 2025-11-27T00:44:17,704 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml' 2025-11-27T00:44:17,705 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml' 2025-11-27T00:44:17,706 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml' 2025-11-27T00:44:17,707 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml' 2025-11-27T00:44:17,708 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml' 2025-11-27T00:44:17,710 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml' 2025-11-27T00:44:17,711 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml' 2025-11-27T00:44:17,712 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml' 2025-11-27T00:44:17,713 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml' 2025-11-27T00:44:17,715 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml' 2025-11-27T00:44:17,716 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml' 2025-11-27T00:44:17,718 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml' 2025-11-27T00:44:17,719 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml' 2025-11-27T00:44:17,720 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml' 2025-11-27T00:44:17,722 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml' 2025-11-27T00:44:17,723 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml' 2025-11-27T00:44:17,724 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml' 2025-11-27T00:44:17,726 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml' 2025-11-27T00:44:17,727 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml' 2025-11-27T00:44:17,728 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml' 2025-11-27T00:44:17,730 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml' 2025-11-27T00:44:17,731 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml' 2025-11-27T00:44:17,732 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml' 2025-11-27T00:44:17,734 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml' 2025-11-27T00:44:17,735 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml' 2025-11-27T00:44:17,739 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml' 2025-11-27T00:44:17,740 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml' 2025-11-27T00:44:17,742 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml' 2025-11-27T00:44:17,743 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml' 2025-11-27T00:44:17,744 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml' 2025-11-27T00:44:17,746 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml' 2025-11-27T00:44:17,747 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml' 2025-11-27T00:44:17,749 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml' 2025-11-27T00:44:17,750 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml' 2025-11-27T00:44:17,753 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml' 2025-11-27T00:44:17,755 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml' 2025-11-27T00:44:17,756 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml' 2025-11-27T00:44:17,758 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml' 2025-11-27T00:44:17,759 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml' 2025-11-27T00:44:17,761 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml' 2025-11-27T00:44:17,762 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml' 2025-11-27T00:44:17,764 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml' 2025-11-27T00:44:17,765 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml' 2025-11-27T00:44:17,766 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml' 2025-11-27T00:44:17,768 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml' 2025-11-27T00:44:17,769 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml' 2025-11-27T00:44:17,770 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml' 2025-11-27T00:44:17,771 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml' 2025-11-27T00:44:17,773 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml' 2025-11-27T00:44:17,774 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml' 2025-11-27T00:44:17,776 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml' 2025-11-27T00:44:17,777 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml' 2025-11-27T00:44:17,779 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml' 2025-11-27T00:44:17,781 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml' 2025-11-27T00:44:17,782 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml' 2025-11-27T00:44:17,784 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml' 2025-11-27T00:44:17,785 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml' 2025-11-27T00:44:17,787 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml' 2025-11-27T00:44:17,788 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml' 2025-11-27T00:44:17,790 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml' 2025-11-27T00:44:17,791 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml' 2025-11-27T00:44:17,792 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/utils.py' 2025-11-27T00:44:17,795 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml' 2025-11-27T00:44:17,796 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml' 2025-11-27T00:44:17,798 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml' 2025-11-27T00:44:17,799 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml' 2025-11-27T00:44:17,800 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml' 2025-11-27T00:44:17,801 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml' 2025-11-27T00:44:17,803 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml' 2025-11-27T00:44:17,804 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml' 2025-11-27T00:44:17,805 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml' 2025-11-27T00:44:17,807 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml' 2025-11-27T00:44:17,808 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml' 2025-11-27T00:44:17,810 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml' 2025-11-27T00:44:17,811 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml' 2025-11-27T00:44:17,812 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml' 2025-11-27T00:44:17,814 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml' 2025-11-27T00:44:17,815 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml' 2025-11-27T00:44:17,817 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml' 2025-11-27T00:44:17,818 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml' 2025-11-27T00:44:17,819 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml' 2025-11-27T00:44:17,821 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml' 2025-11-27T00:44:17,822 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml' 2025-11-27T00:44:17,823 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml' 2025-11-27T00:44:17,825 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml' 2025-11-27T00:44:17,826 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml' 2025-11-27T00:44:17,827 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml' 2025-11-27T00:44:17,829 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml' 2025-11-27T00:44:17,830 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml' 2025-11-27T00:44:17,833 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml' 2025-11-27T00:44:17,834 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml' 2025-11-27T00:44:17,836 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml' 2025-11-27T00:44:17,837 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml' 2025-11-27T00:44:17,838 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml' 2025-11-27T00:44:17,840 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml' 2025-11-27T00:44:17,841 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml' 2025-11-27T00:44:17,842 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml' 2025-11-27T00:44:17,844 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml' 2025-11-27T00:44:17,846 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml' 2025-11-27T00:44:17,848 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml' 2025-11-27T00:44:17,849 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml' 2025-11-27T00:44:17,850 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml' 2025-11-27T00:44:17,852 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml' 2025-11-27T00:44:17,853 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml' 2025-11-27T00:44:17,855 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml' 2025-11-27T00:44:17,856 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml' 2025-11-27T00:44:17,857 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml' 2025-11-27T00:44:17,859 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml' 2025-11-27T00:44:17,860 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml' 2025-11-27T00:44:17,861 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml' 2025-11-27T00:44:17,863 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml' 2025-11-27T00:44:17,864 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml' 2025-11-27T00:44:17,866 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml' 2025-11-27T00:44:17,867 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml' 2025-11-27T00:44:17,868 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml' 2025-11-27T00:44:17,870 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml' 2025-11-27T00:44:17,872 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml' 2025-11-27T00:44:17,873 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml' 2025-11-27T00:44:17,875 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml' 2025-11-27T00:44:17,876 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml' 2025-11-27T00:44:17,878 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml' 2025-11-27T00:44:17,880 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml' 2025-11-27T00:44:17,881 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml' 2025-11-27T00:44:17,882 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml' 2025-11-27T00:44:17,883 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml' 2025-11-27T00:44:17,885 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/utils.py' 2025-11-27T00:44:17,888 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml' 2025-11-27T00:44:17,889 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml' 2025-11-27T00:44:17,890 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml' 2025-11-27T00:44:17,891 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml' 2025-11-27T00:44:17,892 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml' 2025-11-27T00:44:17,894 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml' 2025-11-27T00:44:17,895 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml' 2025-11-27T00:44:17,896 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml' 2025-11-27T00:44:17,897 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml' 2025-11-27T00:44:17,899 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml' 2025-11-27T00:44:17,900 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml' 2025-11-27T00:44:17,902 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml' 2025-11-27T00:44:17,903 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml' 2025-11-27T00:44:17,904 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml' 2025-11-27T00:44:17,906 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml' 2025-11-27T00:44:17,907 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml' 2025-11-27T00:44:17,909 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml' 2025-11-27T00:44:17,910 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml' 2025-11-27T00:44:17,911 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml' 2025-11-27T00:44:17,913 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml' 2025-11-27T00:44:17,914 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml' 2025-11-27T00:44:17,916 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml' 2025-11-27T00:44:17,917 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml' 2025-11-27T00:44:17,918 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml' 2025-11-27T00:44:17,920 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml' 2025-11-27T00:44:17,921 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml' 2025-11-27T00:44:17,923 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml' 2025-11-27T00:44:17,926 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml' 2025-11-27T00:44:17,927 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml' 2025-11-27T00:44:17,929 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml' 2025-11-27T00:44:17,930 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml' 2025-11-27T00:44:17,931 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml' 2025-11-27T00:44:17,933 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml' 2025-11-27T00:44:17,934 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml' 2025-11-27T00:44:17,936 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml' 2025-11-27T00:44:17,937 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml' 2025-11-27T00:44:17,940 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml' 2025-11-27T00:44:17,941 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml' 2025-11-27T00:44:17,943 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml' 2025-11-27T00:44:17,944 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml' 2025-11-27T00:44:17,945 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml' 2025-11-27T00:44:17,947 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml' 2025-11-27T00:44:17,948 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml' 2025-11-27T00:44:17,949 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml' 2025-11-27T00:44:17,951 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml' 2025-11-27T00:44:17,952 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml' 2025-11-27T00:44:17,953 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml' 2025-11-27T00:44:17,955 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml' 2025-11-27T00:44:17,956 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml' 2025-11-27T00:44:17,957 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml' 2025-11-27T00:44:17,959 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml' 2025-11-27T00:44:17,960 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml' 2025-11-27T00:44:17,962 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml' 2025-11-27T00:44:17,963 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml' 2025-11-27T00:44:17,965 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml' 2025-11-27T00:44:17,967 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml' 2025-11-27T00:44:17,968 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml' 2025-11-27T00:44:17,970 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml' 2025-11-27T00:44:17,971 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml' 2025-11-27T00:44:17,973 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml' 2025-11-27T00:44:17,974 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml' 2025-11-27T00:44:17,976 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml' 2025-11-27T00:44:17,977 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml' 2025-11-27T00:44:17,978 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py' 2025-11-27T00:44:17,981 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml' 2025-11-27T00:44:17,982 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml' 2025-11-27T00:44:17,984 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml' 2025-11-27T00:44:17,985 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml' 2025-11-27T00:44:17,986 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml' 2025-11-27T00:44:17,987 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml' 2025-11-27T00:44:17,989 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml' 2025-11-27T00:44:17,990 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml' 2025-11-27T00:44:17,992 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml' 2025-11-27T00:44:17,995 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml' 2025-11-27T00:44:17,996 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml' 2025-11-27T00:44:17,999 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml' 2025-11-27T00:44:18,000 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml' 2025-11-27T00:44:18,003 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml' 2025-11-27T00:44:18,005 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml' 2025-11-27T00:44:18,006 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml' 2025-11-27T00:44:18,008 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml' 2025-11-27T00:44:18,010 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml' 2025-11-27T00:44:18,011 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml' 2025-11-27T00:44:18,013 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml' 2025-11-27T00:44:18,015 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml' 2025-11-27T00:44:18,017 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml' 2025-11-27T00:44:18,019 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml' 2025-11-27T00:44:18,020 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml' 2025-11-27T00:44:18,022 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml' 2025-11-27T00:44:18,024 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml' 2025-11-27T00:44:18,027 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml' 2025-11-27T00:44:18,036 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml' 2025-11-27T00:44:18,038 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml' 2025-11-27T00:44:18,040 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml' 2025-11-27T00:44:18,042 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml' 2025-11-27T00:44:18,044 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml' 2025-11-27T00:44:18,045 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml' 2025-11-27T00:44:18,047 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml' 2025-11-27T00:44:18,049 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml' 2025-11-27T00:44:18,052 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml' 2025-11-27T00:44:18,059 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml' 2025-11-27T00:44:18,063 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml' 2025-11-27T00:44:18,065 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml' 2025-11-27T00:44:18,067 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml' 2025-11-27T00:44:18,069 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml' 2025-11-27T00:44:18,071 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml' 2025-11-27T00:44:18,073 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml' 2025-11-27T00:44:18,076 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml' 2025-11-27T00:44:18,077 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml' 2025-11-27T00:44:18,080 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml' 2025-11-27T00:44:18,081 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml' 2025-11-27T00:44:18,083 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml' 2025-11-27T00:44:18,085 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml' 2025-11-27T00:44:18,087 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml' 2025-11-27T00:44:18,089 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml' 2025-11-27T00:44:18,091 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml' 2025-11-27T00:44:18,093 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml' 2025-11-27T00:44:18,095 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml' 2025-11-27T00:44:18,100 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml' 2025-11-27T00:44:18,104 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml' 2025-11-27T00:44:18,106 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml' 2025-11-27T00:44:18,108 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml' 2025-11-27T00:44:18,113 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml' 2025-11-27T00:44:18,115 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml' 2025-11-27T00:44:18,117 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml' 2025-11-27T00:44:18,119 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml' 2025-11-27T00:44:18,120 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml' 2025-11-27T00:44:18,122 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py' 2025-11-27T00:44:18,125 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml' 2025-11-27T00:44:18,126 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml' 2025-11-27T00:44:18,127 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml' 2025-11-27T00:44:18,128 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml' 2025-11-27T00:44:18,129 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml' 2025-11-27T00:44:18,130 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml' 2025-11-27T00:44:18,132 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml' 2025-11-27T00:44:18,133 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml' 2025-11-27T00:44:18,135 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml' 2025-11-27T00:44:18,136 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml' 2025-11-27T00:44:18,137 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml' 2025-11-27T00:44:18,139 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml' 2025-11-27T00:44:18,140 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml' 2025-11-27T00:44:18,142 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml' 2025-11-27T00:44:18,143 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml' 2025-11-27T00:44:18,144 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml' 2025-11-27T00:44:18,146 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml' 2025-11-27T00:44:18,147 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml' 2025-11-27T00:44:18,148 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml' 2025-11-27T00:44:18,150 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml' 2025-11-27T00:44:18,151 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml' 2025-11-27T00:44:18,153 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml' 2025-11-27T00:44:18,154 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml' 2025-11-27T00:44:18,155 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml' 2025-11-27T00:44:18,157 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml' 2025-11-27T00:44:18,158 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml' 2025-11-27T00:44:18,160 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml' 2025-11-27T00:44:18,162 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml' 2025-11-27T00:44:18,163 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml' 2025-11-27T00:44:18,165 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml' 2025-11-27T00:44:18,166 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml' 2025-11-27T00:44:18,167 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml' 2025-11-27T00:44:18,168 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml' 2025-11-27T00:44:18,170 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml' 2025-11-27T00:44:18,171 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml' 2025-11-27T00:44:18,173 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml' 2025-11-27T00:44:18,175 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml' 2025-11-27T00:44:18,177 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml' 2025-11-27T00:44:18,178 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml' 2025-11-27T00:44:18,179 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml' 2025-11-27T00:44:18,181 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml' 2025-11-27T00:44:18,182 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml' 2025-11-27T00:44:18,183 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml' 2025-11-27T00:44:18,185 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml' 2025-11-27T00:44:18,186 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml' 2025-11-27T00:44:18,187 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml' 2025-11-27T00:44:18,189 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml' 2025-11-27T00:44:18,190 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml' 2025-11-27T00:44:18,191 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml' 2025-11-27T00:44:18,193 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml' 2025-11-27T00:44:18,194 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml' 2025-11-27T00:44:18,195 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml' 2025-11-27T00:44:18,197 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml' 2025-11-27T00:44:18,198 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml' 2025-11-27T00:44:18,200 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml' 2025-11-27T00:44:18,202 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml' 2025-11-27T00:44:18,203 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml' 2025-11-27T00:44:18,205 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml' 2025-11-27T00:44:18,206 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml' 2025-11-27T00:44:18,208 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml' 2025-11-27T00:44:18,209 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml' 2025-11-27T00:44:18,210 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml' 2025-11-27T00:44:18,212 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml' 2025-11-27T00:44:18,213 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/utils.py' 2025-11-27T00:44:18,215 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml' 2025-11-27T00:44:18,217 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml' 2025-11-27T00:44:18,218 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml' 2025-11-27T00:44:18,219 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml' 2025-11-27T00:44:18,220 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml' 2025-11-27T00:44:18,221 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml' 2025-11-27T00:44:18,222 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml' 2025-11-27T00:44:18,223 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml' 2025-11-27T00:44:18,224 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml' 2025-11-27T00:44:18,225 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml' 2025-11-27T00:44:18,226 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml' 2025-11-27T00:44:18,227 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml' 2025-11-27T00:44:18,229 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml' 2025-11-27T00:44:18,230 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml' 2025-11-27T00:44:18,231 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml' 2025-11-27T00:44:18,232 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml' 2025-11-27T00:44:18,233 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py' 2025-11-27T00:44:18,236 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml' 2025-11-27T00:44:18,237 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml' 2025-11-27T00:44:18,238 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml' 2025-11-27T00:44:18,239 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml' 2025-11-27T00:44:18,241 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml' 2025-11-27T00:44:18,242 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml' 2025-11-27T00:44:18,243 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml' 2025-11-27T00:44:18,244 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml' 2025-11-27T00:44:18,246 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml' 2025-11-27T00:44:18,247 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml' 2025-11-27T00:44:18,248 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml' 2025-11-27T00:44:18,250 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml' 2025-11-27T00:44:18,251 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml' 2025-11-27T00:44:18,253 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml' 2025-11-27T00:44:18,254 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml' 2025-11-27T00:44:18,256 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml' 2025-11-27T00:44:18,257 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml' 2025-11-27T00:44:18,258 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml' 2025-11-27T00:44:18,260 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml' 2025-11-27T00:44:18,261 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml' 2025-11-27T00:44:18,262 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml' 2025-11-27T00:44:18,264 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml' 2025-11-27T00:44:18,265 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml' 2025-11-27T00:44:18,266 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml' 2025-11-27T00:44:18,268 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml' 2025-11-27T00:44:18,269 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml' 2025-11-27T00:44:18,271 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml' 2025-11-27T00:44:18,273 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml' 2025-11-27T00:44:18,275 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml' 2025-11-27T00:44:18,276 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml' 2025-11-27T00:44:18,277 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml' 2025-11-27T00:44:18,279 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml' 2025-11-27T00:44:18,280 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml' 2025-11-27T00:44:18,281 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml' 2025-11-27T00:44:18,283 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml' 2025-11-27T00:44:18,284 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml' 2025-11-27T00:44:18,286 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml' 2025-11-27T00:44:18,288 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml' 2025-11-27T00:44:18,290 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml' 2025-11-27T00:44:18,291 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml' 2025-11-27T00:44:18,292 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml' 2025-11-27T00:44:18,294 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml' 2025-11-27T00:44:18,295 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml' 2025-11-27T00:44:18,296 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml' 2025-11-27T00:44:18,298 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml' 2025-11-27T00:44:18,299 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml' 2025-11-27T00:44:18,301 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml' 2025-11-27T00:44:18,302 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml' 2025-11-27T00:44:18,303 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml' 2025-11-27T00:44:18,305 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml' 2025-11-27T00:44:18,306 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml' 2025-11-27T00:44:18,307 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml' 2025-11-27T00:44:18,309 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml' 2025-11-27T00:44:18,310 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml' 2025-11-27T00:44:18,312 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml' 2025-11-27T00:44:18,314 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml' 2025-11-27T00:44:18,315 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml' 2025-11-27T00:44:18,317 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml' 2025-11-27T00:44:18,319 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml' 2025-11-27T00:44:18,320 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml' 2025-11-27T00:44:18,321 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml' 2025-11-27T00:44:18,323 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml' 2025-11-27T00:44:18,324 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml' 2025-11-27T00:44:18,325 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py' 2025-11-27T00:44:18,329 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml' 2025-11-27T00:44:18,330 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml' 2025-11-27T00:44:18,331 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml' 2025-11-27T00:44:18,332 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml' 2025-11-27T00:44:18,333 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml' 2025-11-27T00:44:18,334 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml' 2025-11-27T00:44:18,336 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml' 2025-11-27T00:44:18,337 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml' 2025-11-27T00:44:18,339 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml' 2025-11-27T00:44:18,342 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml' 2025-11-27T00:44:18,343 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml' 2025-11-27T00:44:18,345 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml' 2025-11-27T00:44:18,347 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml' 2025-11-27T00:44:18,350 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml' 2025-11-27T00:44:18,351 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml' 2025-11-27T00:44:18,353 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml' 2025-11-27T00:44:18,355 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml' 2025-11-27T00:44:18,357 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml' 2025-11-27T00:44:18,359 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml' 2025-11-27T00:44:18,361 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml' 2025-11-27T00:44:18,362 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml' 2025-11-27T00:44:18,364 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml' 2025-11-27T00:44:18,367 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml' 2025-11-27T00:44:18,369 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml' 2025-11-27T00:44:18,371 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml' 2025-11-27T00:44:18,372 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml' 2025-11-27T00:44:18,375 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml' 2025-11-27T00:44:18,385 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml' 2025-11-27T00:44:18,387 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml' 2025-11-27T00:44:18,389 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml' 2025-11-27T00:44:18,391 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml' 2025-11-27T00:44:18,393 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml' 2025-11-27T00:44:18,395 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml' 2025-11-27T00:44:18,397 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml' 2025-11-27T00:44:18,400 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml' 2025-11-27T00:44:18,402 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml' 2025-11-27T00:44:18,411 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml' 2025-11-27T00:44:18,416 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml' 2025-11-27T00:44:18,418 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml' 2025-11-27T00:44:18,419 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml' 2025-11-27T00:44:18,422 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml' 2025-11-27T00:44:18,423 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml' 2025-11-27T00:44:18,425 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml' 2025-11-27T00:44:18,427 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml' 2025-11-27T00:44:18,429 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml' 2025-11-27T00:44:18,431 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml' 2025-11-27T00:44:18,433 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml' 2025-11-27T00:44:18,434 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml' 2025-11-27T00:44:18,436 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml' 2025-11-27T00:44:18,438 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml' 2025-11-27T00:44:18,440 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml' 2025-11-27T00:44:18,442 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml' 2025-11-27T00:44:18,444 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml' 2025-11-27T00:44:18,447 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml' 2025-11-27T00:44:18,454 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml' 2025-11-27T00:44:18,457 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml' 2025-11-27T00:44:18,460 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml' 2025-11-27T00:44:18,462 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml' 2025-11-27T00:44:18,466 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml' 2025-11-27T00:44:18,468 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml' 2025-11-27T00:44:18,470 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml' 2025-11-27T00:44:18,472 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml' 2025-11-27T00:44:18,474 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml' 2025-11-27T00:44:18,475 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/utils.py' 2025-11-27T00:44:18,479 adding 'lm_eval/tasks/lm_syneval/README.md' 2025-11-27T00:44:18,480 adding 'lm_eval/tasks/lm_syneval/_template_yaml' 2025-11-27T00:44:18,482 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml' 2025-11-27T00:44:18,483 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml' 2025-11-27T00:44:18,484 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2025-11-27T00:44:18,485 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2025-11-27T00:44:18,486 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2025-11-27T00:44:18,487 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2025-11-27T00:44:18,489 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2025-11-27T00:44:18,490 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2025-11-27T00:44:18,491 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2025-11-27T00:44:18,492 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2025-11-27T00:44:18,493 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2025-11-27T00:44:18,494 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2025-11-27T00:44:18,495 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2025-11-27T00:44:18,496 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2025-11-27T00:44:18,497 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2025-11-27T00:44:18,498 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2025-11-27T00:44:18,499 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2025-11-27T00:44:18,500 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2025-11-27T00:44:18,502 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2025-11-27T00:44:18,503 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2025-11-27T00:44:18,504 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2025-11-27T00:44:18,505 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2025-11-27T00:44:18,506 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2025-11-27T00:44:18,507 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2025-11-27T00:44:18,508 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2025-11-27T00:44:18,509 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2025-11-27T00:44:18,510 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2025-11-27T00:44:18,512 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2025-11-27T00:44:18,515 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2025-11-27T00:44:18,516 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2025-11-27T00:44:18,517 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2025-11-27T00:44:18,518 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2025-11-27T00:44:18,519 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2025-11-27T00:44:18,520 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2025-11-27T00:44:18,522 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml' 2025-11-27T00:44:18,523 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml' 2025-11-27T00:44:18,524 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml' 2025-11-27T00:44:18,525 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml' 2025-11-27T00:44:18,526 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml' 2025-11-27T00:44:18,527 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml' 2025-11-27T00:44:18,529 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml' 2025-11-27T00:44:18,530 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml' 2025-11-27T00:44:18,531 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml' 2025-11-27T00:44:18,532 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml' 2025-11-27T00:44:18,533 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml' 2025-11-27T00:44:18,534 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml' 2025-11-27T00:44:18,535 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml' 2025-11-27T00:44:18,536 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml' 2025-11-27T00:44:18,537 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml' 2025-11-27T00:44:18,538 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml' 2025-11-27T00:44:18,539 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml' 2025-11-27T00:44:18,540 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml' 2025-11-27T00:44:18,541 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml' 2025-11-27T00:44:18,543 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml' 2025-11-27T00:44:18,544 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml' 2025-11-27T00:44:18,545 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml' 2025-11-27T00:44:18,546 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml' 2025-11-27T00:44:18,547 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml' 2025-11-27T00:44:18,548 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml' 2025-11-27T00:44:18,549 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml' 2025-11-27T00:44:18,550 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml' 2025-11-27T00:44:18,552 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml' 2025-11-27T00:44:18,553 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml' 2025-11-27T00:44:18,554 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml' 2025-11-27T00:44:18,555 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml' 2025-11-27T00:44:18,556 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml' 2025-11-27T00:44:18,557 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml' 2025-11-27T00:44:18,558 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml' 2025-11-27T00:44:18,560 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml' 2025-11-27T00:44:18,561 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml' 2025-11-27T00:44:18,562 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml' 2025-11-27T00:44:18,563 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml' 2025-11-27T00:44:18,564 adding 'lm_eval/tasks/lm_syneval/lm_syneval_group.yaml' 2025-11-27T00:44:18,566 adding 'lm_eval/tasks/logiqa/README.md' 2025-11-27T00:44:18,568 adding 'lm_eval/tasks/logiqa/logiqa.yaml' 2025-11-27T00:44:18,569 adding 'lm_eval/tasks/logiqa/utils_logiqa.py' 2025-11-27T00:44:18,571 adding 'lm_eval/tasks/logiqa2/README.md' 2025-11-27T00:44:18,572 adding 'lm_eval/tasks/logiqa2/logieval.yaml' 2025-11-27T00:44:18,573 adding 'lm_eval/tasks/logiqa2/logiqa2.yaml' 2025-11-27T00:44:18,574 adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py' 2025-11-27T00:44:18,577 adding 'lm_eval/tasks/longbench/2wikimqa.yaml' 2025-11-27T00:44:18,578 adding 'lm_eval/tasks/longbench/2wikimqa_e.yaml' 2025-11-27T00:44:18,580 adding 'lm_eval/tasks/longbench/README.md' 2025-11-27T00:44:18,582 adding 'lm_eval/tasks/longbench/_generate_config.py' 2025-11-27T00:44:18,583 adding 'lm_eval/tasks/longbench/_longbench.yaml' 2025-11-27T00:44:18,584 adding 'lm_eval/tasks/longbench/_longbench_code.yaml' 2025-11-27T00:44:18,585 adding 'lm_eval/tasks/longbench/_longbench_code_e.yaml' 2025-11-27T00:44:18,586 adding 'lm_eval/tasks/longbench/_longbench_e.yaml' 2025-11-27T00:44:18,587 adding 'lm_eval/tasks/longbench/_longbench_fewshot.yaml' 2025-11-27T00:44:18,588 adding 'lm_eval/tasks/longbench/_longbench_fewshot_e.yaml' 2025-11-27T00:44:18,590 adding 'lm_eval/tasks/longbench/_longbench_multi.yaml' 2025-11-27T00:44:18,591 adding 'lm_eval/tasks/longbench/_longbench_multi_e.yaml' 2025-11-27T00:44:18,592 adding 'lm_eval/tasks/longbench/_longbench_single.yaml' 2025-11-27T00:44:18,593 adding 'lm_eval/tasks/longbench/_longbench_single_e.yaml' 2025-11-27T00:44:18,594 adding 'lm_eval/tasks/longbench/_longbench_summarization.yaml' 2025-11-27T00:44:18,595 adding 'lm_eval/tasks/longbench/_longbench_summarization_e.yaml' 2025-11-27T00:44:18,596 adding 'lm_eval/tasks/longbench/_longbench_synthetic.yaml' 2025-11-27T00:44:18,597 adding 'lm_eval/tasks/longbench/_longbench_synthetic_e.yaml' 2025-11-27T00:44:18,598 adding 'lm_eval/tasks/longbench/dureader.yaml' 2025-11-27T00:44:18,600 adding 'lm_eval/tasks/longbench/gov_report.yaml' 2025-11-27T00:44:18,601 adding 'lm_eval/tasks/longbench/gov_report_e.yaml' 2025-11-27T00:44:18,602 adding 'lm_eval/tasks/longbench/hotpotqa.yaml' 2025-11-27T00:44:18,603 adding 'lm_eval/tasks/longbench/hotpotqa_e.yaml' 2025-11-27T00:44:18,604 adding 'lm_eval/tasks/longbench/lcc.yaml' 2025-11-27T00:44:18,606 adding 'lm_eval/tasks/longbench/lcc_e.yaml' 2025-11-27T00:44:18,607 adding 'lm_eval/tasks/longbench/lsht.yaml' 2025-11-27T00:44:18,609 adding 'lm_eval/tasks/longbench/metrics.py' 2025-11-27T00:44:18,610 adding 'lm_eval/tasks/longbench/multi_news.yaml' 2025-11-27T00:44:18,611 adding 'lm_eval/tasks/longbench/multi_news_e.yaml' 2025-11-27T00:44:18,612 adding 'lm_eval/tasks/longbench/multifieldqa_en.yaml' 2025-11-27T00:44:18,613 adding 'lm_eval/tasks/longbench/multifieldqa_en_e.yaml' 2025-11-27T00:44:18,615 adding 'lm_eval/tasks/longbench/multifieldqa_zh.yaml' 2025-11-27T00:44:18,616 adding 'lm_eval/tasks/longbench/musique.yaml' 2025-11-27T00:44:18,617 adding 'lm_eval/tasks/longbench/narrativeqa.yaml' 2025-11-27T00:44:18,618 adding 'lm_eval/tasks/longbench/passage_count.yaml' 2025-11-27T00:44:18,620 adding 'lm_eval/tasks/longbench/passage_count_e.yaml' 2025-11-27T00:44:18,621 adding 'lm_eval/tasks/longbench/passage_retrieval_en.yaml' 2025-11-27T00:44:18,622 adding 'lm_eval/tasks/longbench/passage_retrieval_en_e.yaml' 2025-11-27T00:44:18,623 adding 'lm_eval/tasks/longbench/passage_retrieval_zh.yaml' 2025-11-27T00:44:18,625 adding 'lm_eval/tasks/longbench/qasper.yaml' 2025-11-27T00:44:18,626 adding 'lm_eval/tasks/longbench/qasper_e.yaml' 2025-11-27T00:44:18,627 adding 'lm_eval/tasks/longbench/qmsum.yaml' 2025-11-27T00:44:18,629 adding 'lm_eval/tasks/longbench/repobench-p.yaml' 2025-11-27T00:44:18,630 adding 'lm_eval/tasks/longbench/repobench-p_e.yaml' 2025-11-27T00:44:18,631 adding 'lm_eval/tasks/longbench/samsum.yaml' 2025-11-27T00:44:18,632 adding 'lm_eval/tasks/longbench/samsum_e.yaml' 2025-11-27T00:44:18,634 adding 'lm_eval/tasks/longbench/trec.yaml' 2025-11-27T00:44:18,635 adding 'lm_eval/tasks/longbench/trec_e.yaml' 2025-11-27T00:44:18,636 adding 'lm_eval/tasks/longbench/triviaqa.yaml' 2025-11-27T00:44:18,637 adding 'lm_eval/tasks/longbench/triviaqa_e.yaml' 2025-11-27T00:44:18,639 adding 'lm_eval/tasks/longbench/utils.py' 2025-11-27T00:44:18,640 adding 'lm_eval/tasks/longbench/vcsum.yaml' 2025-11-27T00:44:18,642 adding 'lm_eval/tasks/longbench2/README.md' 2025-11-27T00:44:18,644 adding 'lm_eval/tasks/longbench2/_longbench2.yaml' 2025-11-27T00:44:18,645 adding 'lm_eval/tasks/longbench2/_longbench2_history.yaml' 2025-11-27T00:44:18,646 adding 'lm_eval/tasks/longbench2/_longbench2_incontext.yaml' 2025-11-27T00:44:18,647 adding 'lm_eval/tasks/longbench2/_longbench2_multi.yaml' 2025-11-27T00:44:18,648 adding 'lm_eval/tasks/longbench2/_longbench2_single.yaml' 2025-11-27T00:44:18,649 adding 'lm_eval/tasks/longbench2/_longbench2_structured.yaml' 2025-11-27T00:44:18,650 adding 'lm_eval/tasks/longbench2/_longbench_common_yaml' 2025-11-27T00:44:18,651 adding 'lm_eval/tasks/longbench2/academic_multi_doc.yaml' 2025-11-27T00:44:18,652 adding 'lm_eval/tasks/longbench2/academic_single.yaml' 2025-11-27T00:44:18,654 adding 'lm_eval/tasks/longbench2/agent_history.yaml' 2025-11-27T00:44:18,655 adding 'lm_eval/tasks/longbench2/detective.yaml' 2025-11-27T00:44:18,656 adding 'lm_eval/tasks/longbench2/dialogue_history.yaml' 2025-11-27T00:44:18,657 adding 'lm_eval/tasks/longbench2/event_order.yaml' 2025-11-27T00:44:18,658 adding 'lm_eval/tasks/longbench2/fin_multi_doc.yaml' 2025-11-27T00:44:18,659 adding 'lm_eval/tasks/longbench2/fin_single_doc.yaml' 2025-11-27T00:44:18,660 adding 'lm_eval/tasks/longbench2/govt_multi_doc.yaml' 2025-11-27T00:44:18,661 adding 'lm_eval/tasks/longbench2/govt_single_doc.yaml' 2025-11-27T00:44:18,662 adding 'lm_eval/tasks/longbench2/graph.yaml' 2025-11-27T00:44:18,663 adding 'lm_eval/tasks/longbench2/legal_multi.yaml' 2025-11-27T00:44:18,664 adding 'lm_eval/tasks/longbench2/legal_single.yaml' 2025-11-27T00:44:18,665 adding 'lm_eval/tasks/longbench2/lit_single_doc.yaml' 2025-11-27T00:44:18,667 adding 'lm_eval/tasks/longbench2/longbench2_code.yaml' 2025-11-27T00:44:18,668 adding 'lm_eval/tasks/longbench2/many_shot.yaml' 2025-11-27T00:44:18,669 adding 'lm_eval/tasks/longbench2/news_multi.yaml' 2025-11-27T00:44:18,670 adding 'lm_eval/tasks/longbench2/table.yaml' 2025-11-27T00:44:18,671 adding 'lm_eval/tasks/longbench2/translate.yaml' 2025-11-27T00:44:18,672 adding 'lm_eval/tasks/longbench2/user_guide.yaml' 2025-11-27T00:44:18,674 adding 'lm_eval/tasks/mastermind/README.md' 2025-11-27T00:44:18,676 adding 'lm_eval/tasks/mastermind/mastermind_24_easy.yaml' 2025-11-27T00:44:18,677 adding 'lm_eval/tasks/mastermind/mastermind_24_hard.yaml' 2025-11-27T00:44:18,678 adding 'lm_eval/tasks/mastermind/mastermind_35_easy.yaml' 2025-11-27T00:44:18,679 adding 'lm_eval/tasks/mastermind/mastermind_35_hard.yaml' 2025-11-27T00:44:18,680 adding 'lm_eval/tasks/mastermind/mastermind_46_easy.yaml' 2025-11-27T00:44:18,681 adding 'lm_eval/tasks/mastermind/mastermind_46_hard.yaml' 2025-11-27T00:44:18,683 adding 'lm_eval/tasks/mathqa/README.md' 2025-11-27T00:44:18,684 adding 'lm_eval/tasks/mathqa/mathqa.yaml' 2025-11-27T00:44:18,685 adding 'lm_eval/tasks/mathqa/utils.py' 2025-11-27T00:44:18,687 adding 'lm_eval/tasks/mbpp/README.md' 2025-11-27T00:44:18,689 adding 'lm_eval/tasks/mbpp/mbpp.yaml' 2025-11-27T00:44:18,690 adding 'lm_eval/tasks/mbpp/mbpp_instruct.yaml' 2025-11-27T00:44:18,691 adding 'lm_eval/tasks/mbpp/mbpp_plus.yaml' 2025-11-27T00:44:18,692 adding 'lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml' 2025-11-27T00:44:18,694 adding 'lm_eval/tasks/mbpp/utils.py' 2025-11-27T00:44:18,696 adding 'lm_eval/tasks/mc_taco/README.md' 2025-11-27T00:44:18,697 adding 'lm_eval/tasks/mc_taco/default.yaml' 2025-11-27T00:44:18,699 adding 'lm_eval/tasks/med_concepts_qa/README.md' 2025-11-27T00:44:18,700 adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml' 2025-11-27T00:44:18,701 adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py' 2025-11-27T00:44:18,703 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml' 2025-11-27T00:44:18,704 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml' 2025-11-27T00:44:18,705 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml' 2025-11-27T00:44:18,706 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml' 2025-11-27T00:44:18,707 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml' 2025-11-27T00:44:18,708 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml' 2025-11-27T00:44:18,709 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml' 2025-11-27T00:44:18,710 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml' 2025-11-27T00:44:18,711 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml' 2025-11-27T00:44:18,713 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml' 2025-11-27T00:44:18,714 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml' 2025-11-27T00:44:18,715 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml' 2025-11-27T00:44:18,716 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml' 2025-11-27T00:44:18,717 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml' 2025-11-27T00:44:18,718 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml' 2025-11-27T00:44:18,719 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml' 2025-11-27T00:44:18,720 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml' 2025-11-27T00:44:18,721 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml' 2025-11-27T00:44:18,722 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml' 2025-11-27T00:44:18,723 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml' 2025-11-27T00:44:18,724 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml' 2025-11-27T00:44:18,726 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml' 2025-11-27T00:44:18,727 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml' 2025-11-27T00:44:18,738 adding 'lm_eval/tasks/med_prescriptions/utils.py' 2025-11-27T00:44:18,741 adding 'lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml' 2025-11-27T00:44:18,742 adding 'lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml' 2025-11-27T00:44:18,743 adding 'lm_eval/tasks/med_text_classification/utils.py' 2025-11-27T00:44:18,745 adding 'lm_eval/tasks/meddialog/README.md' 2025-11-27T00:44:18,746 adding 'lm_eval/tasks/meddialog/meddialog_qsumm.yaml' 2025-11-27T00:44:18,747 adding 'lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml' 2025-11-27T00:44:18,749 adding 'lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml' 2025-11-27T00:44:18,750 adding 'lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml' 2025-11-27T00:44:18,751 adding 'lm_eval/tasks/meddialog/utils.py' 2025-11-27T00:44:18,752 adding 'lm_eval/tasks/meddialog/utils_perplexity.py' 2025-11-27T00:44:18,754 adding 'lm_eval/tasks/mediqa_qa2019/README.md' 2025-11-27T00:44:18,755 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml' 2025-11-27T00:44:18,757 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml' 2025-11-27T00:44:18,758 adding 'lm_eval/tasks/mediqa_qa2019/utils.py' 2025-11-27T00:44:18,759 adding 'lm_eval/tasks/mediqa_qa2019/utils_perplexity.py' 2025-11-27T00:44:18,761 adding 'lm_eval/tasks/medmcqa/medmcqa.yaml' 2025-11-27T00:44:18,762 adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py' 2025-11-27T00:44:18,764 adding 'lm_eval/tasks/medqa/medqa.yaml' 2025-11-27T00:44:18,765 adding 'lm_eval/tasks/medqa/preprocess_medqa.py' 2025-11-27T00:44:18,767 adding 'lm_eval/tasks/medtext/README.md' 2025-11-27T00:44:18,768 adding 'lm_eval/tasks/medtext/medtext.yaml' 2025-11-27T00:44:18,770 adding 'lm_eval/tasks/medtext/medtext_perplexity.yaml' 2025-11-27T00:44:18,771 adding 'lm_eval/tasks/medtext/utils.py' 2025-11-27T00:44:18,772 adding 'lm_eval/tasks/medtext/utils_perplexity.py' 2025-11-27T00:44:18,774 adding 'lm_eval/tasks/mela/README.md' 2025-11-27T00:44:18,775 adding 'lm_eval/tasks/mela/_mela.yaml' 2025-11-27T00:44:18,777 adding 'lm_eval/tasks/mela/mela_ar.yaml' 2025-11-27T00:44:18,778 adding 'lm_eval/tasks/mela/mela_de.yaml' 2025-11-27T00:44:18,779 adding 'lm_eval/tasks/mela/mela_en.yaml' 2025-11-27T00:44:18,780 adding 'lm_eval/tasks/mela/mela_es.yaml' 2025-11-27T00:44:18,781 adding 'lm_eval/tasks/mela/mela_fr.yaml' 2025-11-27T00:44:18,782 adding 'lm_eval/tasks/mela/mela_is.yaml' 2025-11-27T00:44:18,783 adding 'lm_eval/tasks/mela/mela_it.yaml' 2025-11-27T00:44:18,784 adding 'lm_eval/tasks/mela/mela_ja.yaml' 2025-11-27T00:44:18,785 adding 'lm_eval/tasks/mela/mela_ru.yaml' 2025-11-27T00:44:18,786 adding 'lm_eval/tasks/mela/mela_zh.yaml' 2025-11-27T00:44:18,788 adding 'lm_eval/tasks/meqsum/README.md' 2025-11-27T00:44:18,789 adding 'lm_eval/tasks/meqsum/meqsum.yaml' 2025-11-27T00:44:18,791 adding 'lm_eval/tasks/meqsum/utils.py' 2025-11-27T00:44:18,793 adding 'lm_eval/tasks/metabench/README.md' 2025-11-27T00:44:18,794 adding 'lm_eval/tasks/metabench/metabench.yaml' 2025-11-27T00:44:18,796 adding 'lm_eval/tasks/metabench/metabench_arc.yaml' 2025-11-27T00:44:18,797 adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml' 2025-11-27T00:44:18,798 adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml' 2025-11-27T00:44:18,799 adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml' 2025-11-27T00:44:18,800 adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml' 2025-11-27T00:44:18,802 adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml' 2025-11-27T00:44:18,803 adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml' 2025-11-27T00:44:18,804 adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml' 2025-11-27T00:44:18,805 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml' 2025-11-27T00:44:18,806 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml' 2025-11-27T00:44:18,807 adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml' 2025-11-27T00:44:18,808 adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml' 2025-11-27T00:44:18,810 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml' 2025-11-27T00:44:18,811 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml' 2025-11-27T00:44:18,812 adding 'lm_eval/tasks/metabench/metabench_permute.yaml' 2025-11-27T00:44:18,813 adding 'lm_eval/tasks/metabench/metabench_secondary.yaml' 2025-11-27T00:44:18,814 adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml' 2025-11-27T00:44:18,815 adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml' 2025-11-27T00:44:18,817 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml' 2025-11-27T00:44:18,818 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml' 2025-11-27T00:44:18,819 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml' 2025-11-27T00:44:18,820 adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml' 2025-11-27T00:44:18,821 adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml' 2025-11-27T00:44:18,823 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml' 2025-11-27T00:44:18,824 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml' 2025-11-27T00:44:18,825 adding 'lm_eval/tasks/metabench/process_docs.py' 2025-11-27T00:44:18,827 adding 'lm_eval/tasks/metabench/process_docs_permute.py' 2025-11-27T00:44:18,829 adding 'lm_eval/tasks/mgsm/README.md' 2025-11-27T00:44:18,830 adding 'lm_eval/tasks/mgsm/gen_yaml.sh' 2025-11-27T00:44:18,832 adding 'lm_eval/tasks/mgsm/utils.py' 2025-11-27T00:44:18,834 adding 'lm_eval/tasks/mgsm/direct/direct_yaml' 2025-11-27T00:44:18,835 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml' 2025-11-27T00:44:18,836 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml' 2025-11-27T00:44:18,838 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml' 2025-11-27T00:44:18,839 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml' 2025-11-27T00:44:18,840 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml' 2025-11-27T00:44:18,841 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml' 2025-11-27T00:44:18,842 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml' 2025-11-27T00:44:18,844 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml' 2025-11-27T00:44:18,845 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml' 2025-11-27T00:44:18,846 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml' 2025-11-27T00:44:18,847 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml' 2025-11-27T00:44:18,849 adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml' 2025-11-27T00:44:18,850 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml' 2025-11-27T00:44:18,851 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml' 2025-11-27T00:44:18,852 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml' 2025-11-27T00:44:18,854 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml' 2025-11-27T00:44:18,855 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml' 2025-11-27T00:44:18,856 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml' 2025-11-27T00:44:18,857 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml' 2025-11-27T00:44:18,858 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml' 2025-11-27T00:44:18,860 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml' 2025-11-27T00:44:18,861 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml' 2025-11-27T00:44:18,862 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml' 2025-11-27T00:44:18,864 adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml' 2025-11-27T00:44:18,865 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml' 2025-11-27T00:44:18,866 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml' 2025-11-27T00:44:18,867 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml' 2025-11-27T00:44:18,869 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml' 2025-11-27T00:44:18,870 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml' 2025-11-27T00:44:18,871 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml' 2025-11-27T00:44:18,872 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml' 2025-11-27T00:44:18,873 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml' 2025-11-27T00:44:18,875 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml' 2025-11-27T00:44:18,876 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml' 2025-11-27T00:44:18,877 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml' 2025-11-27T00:44:18,879 adding 'lm_eval/tasks/mimic_repsum/README.md' 2025-11-27T00:44:18,880 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum.yaml' 2025-11-27T00:44:18,882 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml' 2025-11-27T00:44:18,883 adding 'lm_eval/tasks/mimic_repsum/utils.py' 2025-11-27T00:44:18,884 adding 'lm_eval/tasks/mimic_repsum/utils_perplexity.py' 2025-11-27T00:44:18,886 adding 'lm_eval/tasks/minerva_math/README.md' 2025-11-27T00:44:18,887 adding 'lm_eval/tasks/minerva_math/minerva_math500.yaml' 2025-11-27T00:44:18,889 adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml' 2025-11-27T00:44:18,890 adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml' 2025-11-27T00:44:18,891 adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml' 2025-11-27T00:44:18,892 adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml' 2025-11-27T00:44:18,893 adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml' 2025-11-27T00:44:18,894 adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml' 2025-11-27T00:44:18,896 adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml' 2025-11-27T00:44:18,897 adding 'lm_eval/tasks/minerva_math/utils.py' 2025-11-27T00:44:18,900 adding 'lm_eval/tasks/mlqa/README.md' 2025-11-27T00:44:18,902 adding 'lm_eval/tasks/mlqa/generate_tasks.py' 2025-11-27T00:44:18,903 adding 'lm_eval/tasks/mlqa/mlqa_ar_ar.yaml' 2025-11-27T00:44:18,904 adding 'lm_eval/tasks/mlqa/mlqa_ar_de.yaml' 2025-11-27T00:44:18,905 adding 'lm_eval/tasks/mlqa/mlqa_ar_en.yaml' 2025-11-27T00:44:18,906 adding 'lm_eval/tasks/mlqa/mlqa_ar_es.yaml' 2025-11-27T00:44:18,907 adding 'lm_eval/tasks/mlqa/mlqa_ar_hi.yaml' 2025-11-27T00:44:18,909 adding 'lm_eval/tasks/mlqa/mlqa_ar_vi.yaml' 2025-11-27T00:44:18,910 adding 'lm_eval/tasks/mlqa/mlqa_ar_zh.yaml' 2025-11-27T00:44:18,911 adding 'lm_eval/tasks/mlqa/mlqa_common_yaml' 2025-11-27T00:44:18,912 adding 'lm_eval/tasks/mlqa/mlqa_de_ar.yaml' 2025-11-27T00:44:18,913 adding 'lm_eval/tasks/mlqa/mlqa_de_de.yaml' 2025-11-27T00:44:18,914 adding 'lm_eval/tasks/mlqa/mlqa_de_en.yaml' 2025-11-27T00:44:18,915 adding 'lm_eval/tasks/mlqa/mlqa_de_es.yaml' 2025-11-27T00:44:18,917 adding 'lm_eval/tasks/mlqa/mlqa_de_hi.yaml' 2025-11-27T00:44:18,918 adding 'lm_eval/tasks/mlqa/mlqa_de_vi.yaml' 2025-11-27T00:44:18,919 adding 'lm_eval/tasks/mlqa/mlqa_de_zh.yaml' 2025-11-27T00:44:18,920 adding 'lm_eval/tasks/mlqa/mlqa_en_ar.yaml' 2025-11-27T00:44:18,921 adding 'lm_eval/tasks/mlqa/mlqa_en_de.yaml' 2025-11-27T00:44:18,922 adding 'lm_eval/tasks/mlqa/mlqa_en_en.yaml' 2025-11-27T00:44:18,923 adding 'lm_eval/tasks/mlqa/mlqa_en_es.yaml' 2025-11-27T00:44:18,924 adding 'lm_eval/tasks/mlqa/mlqa_en_hi.yaml' 2025-11-27T00:44:18,925 adding 'lm_eval/tasks/mlqa/mlqa_en_vi.yaml' 2025-11-27T00:44:18,926 adding 'lm_eval/tasks/mlqa/mlqa_en_zh.yaml' 2025-11-27T00:44:18,928 adding 'lm_eval/tasks/mlqa/mlqa_es_ar.yaml' 2025-11-27T00:44:18,929 adding 'lm_eval/tasks/mlqa/mlqa_es_de.yaml' 2025-11-27T00:44:18,930 adding 'lm_eval/tasks/mlqa/mlqa_es_en.yaml' 2025-11-27T00:44:18,931 adding 'lm_eval/tasks/mlqa/mlqa_es_es.yaml' 2025-11-27T00:44:18,932 adding 'lm_eval/tasks/mlqa/mlqa_es_hi.yaml' 2025-11-27T00:44:18,933 adding 'lm_eval/tasks/mlqa/mlqa_es_vi.yaml' 2025-11-27T00:44:18,934 adding 'lm_eval/tasks/mlqa/mlqa_es_zh.yaml' 2025-11-27T00:44:18,935 adding 'lm_eval/tasks/mlqa/mlqa_hi_ar.yaml' 2025-11-27T00:44:18,937 adding 'lm_eval/tasks/mlqa/mlqa_hi_de.yaml' 2025-11-27T00:44:18,938 adding 'lm_eval/tasks/mlqa/mlqa_hi_en.yaml' 2025-11-27T00:44:18,939 adding 'lm_eval/tasks/mlqa/mlqa_hi_es.yaml' 2025-11-27T00:44:18,940 adding 'lm_eval/tasks/mlqa/mlqa_hi_hi.yaml' 2025-11-27T00:44:18,942 adding 'lm_eval/tasks/mlqa/mlqa_hi_vi.yaml' 2025-11-27T00:44:18,943 adding 'lm_eval/tasks/mlqa/mlqa_hi_zh.yaml' 2025-11-27T00:44:18,944 adding 'lm_eval/tasks/mlqa/mlqa_vi_ar.yaml' 2025-11-27T00:44:18,945 adding 'lm_eval/tasks/mlqa/mlqa_vi_de.yaml' 2025-11-27T00:44:18,946 adding 'lm_eval/tasks/mlqa/mlqa_vi_en.yaml' 2025-11-27T00:44:18,947 adding 'lm_eval/tasks/mlqa/mlqa_vi_es.yaml' 2025-11-27T00:44:18,948 adding 'lm_eval/tasks/mlqa/mlqa_vi_hi.yaml' 2025-11-27T00:44:18,950 adding 'lm_eval/tasks/mlqa/mlqa_vi_vi.yaml' 2025-11-27T00:44:18,951 adding 'lm_eval/tasks/mlqa/mlqa_vi_zh.yaml' 2025-11-27T00:44:18,952 adding 'lm_eval/tasks/mlqa/mlqa_zh_ar.yaml' 2025-11-27T00:44:18,953 adding 'lm_eval/tasks/mlqa/mlqa_zh_de.yaml' 2025-11-27T00:44:18,954 adding 'lm_eval/tasks/mlqa/mlqa_zh_en.yaml' 2025-11-27T00:44:18,955 adding 'lm_eval/tasks/mlqa/mlqa_zh_es.yaml' 2025-11-27T00:44:18,957 adding 'lm_eval/tasks/mlqa/mlqa_zh_hi.yaml' 2025-11-27T00:44:18,958 adding 'lm_eval/tasks/mlqa/mlqa_zh_vi.yaml' 2025-11-27T00:44:18,959 adding 'lm_eval/tasks/mlqa/mlqa_zh_zh.yaml' 2025-11-27T00:44:18,960 adding 'lm_eval/tasks/mlqa/utils.py' 2025-11-27T00:44:18,962 adding 'lm_eval/tasks/mmlu/README.md' 2025-11-27T00:44:18,964 adding 'lm_eval/tasks/mmlu/_generate_configs.py' 2025-11-27T00:44:18,967 adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml' 2025-11-27T00:44:18,968 adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml' 2025-11-27T00:44:18,969 adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:18,971 adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml' 2025-11-27T00:44:18,972 adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml' 2025-11-27T00:44:18,973 adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml' 2025-11-27T00:44:18,974 adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:18,976 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml' 2025-11-27T00:44:18,977 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml' 2025-11-27T00:44:18,978 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml' 2025-11-27T00:44:18,979 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml' 2025-11-27T00:44:18,980 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml' 2025-11-27T00:44:18,981 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml' 2025-11-27T00:44:18,983 adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml' 2025-11-27T00:44:18,984 adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:18,985 adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml' 2025-11-27T00:44:18,986 adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:18,987 adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:18,988 adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml' 2025-11-27T00:44:18,989 adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml' 2025-11-27T00:44:18,991 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml' 2025-11-27T00:44:18,992 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:18,993 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:18,994 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:18,995 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml' 2025-11-27T00:44:18,996 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:18,997 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:18,999 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,000 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,001 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,002 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,003 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,004 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,006 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,007 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml' 2025-11-27T00:44:19,008 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,009 adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml' 2025-11-27T00:44:19,010 adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,012 adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,013 adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,014 adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml' 2025-11-27T00:44:19,015 adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml' 2025-11-27T00:44:19,016 adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,017 adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,019 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,020 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,021 adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml' 2025-11-27T00:44:19,022 adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml' 2025-11-27T00:44:19,023 adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml' 2025-11-27T00:44:19,024 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,026 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml' 2025-11-27T00:44:19,027 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,028 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,029 adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml' 2025-11-27T00:44:19,030 adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml' 2025-11-27T00:44:19,031 adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml' 2025-11-27T00:44:19,033 adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,034 adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml' 2025-11-27T00:44:19,035 adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml' 2025-11-27T00:44:19,037 adding 'lm_eval/tasks/mmlu/default/_default_template_yaml' 2025-11-27T00:44:19,039 adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml' 2025-11-27T00:44:19,040 adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml' 2025-11-27T00:44:19,041 adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml' 2025-11-27T00:44:19,042 adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml' 2025-11-27T00:44:19,043 adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml' 2025-11-27T00:44:19,045 adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,046 adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml' 2025-11-27T00:44:19,047 adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml' 2025-11-27T00:44:19,048 adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,049 adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,051 adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml' 2025-11-27T00:44:19,052 adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,053 adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,054 adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,055 adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,056 adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml' 2025-11-27T00:44:19,058 adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml' 2025-11-27T00:44:19,059 adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,060 adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml' 2025-11-27T00:44:19,061 adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,062 adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,063 adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,065 adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml' 2025-11-27T00:44:19,066 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,067 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,068 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,070 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,071 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,072 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,073 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,074 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,075 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,077 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,078 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,079 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,080 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,081 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,083 adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml' 2025-11-27T00:44:19,084 adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,085 adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml' 2025-11-27T00:44:19,086 adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,087 adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,088 adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,090 adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml' 2025-11-27T00:44:19,091 adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml' 2025-11-27T00:44:19,092 adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,093 adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,094 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,095 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,097 adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml' 2025-11-27T00:44:19,098 adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml' 2025-11-27T00:44:19,099 adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml' 2025-11-27T00:44:19,100 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,101 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml' 2025-11-27T00:44:19,102 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,104 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,105 adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml' 2025-11-27T00:44:19,106 adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml' 2025-11-27T00:44:19,107 adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml' 2025-11-27T00:44:19,108 adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,110 adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml' 2025-11-27T00:44:19,111 adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml' 2025-11-27T00:44:19,151 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json' 2025-11-27T00:44:19,153 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml' 2025-11-27T00:44:19,155 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml' 2025-11-27T00:44:19,159 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,161 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml' 2025-11-27T00:44:19,162 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml' 2025-11-27T00:44:19,164 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,165 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,167 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml' 2025-11-27T00:44:19,168 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,170 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,171 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,173 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,174 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml' 2025-11-27T00:44:19,176 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml' 2025-11-27T00:44:19,177 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,179 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml' 2025-11-27T00:44:19,180 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,182 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,183 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,185 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml' 2025-11-27T00:44:19,186 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,187 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,189 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,192 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,193 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,195 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,196 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,197 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,199 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,200 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,202 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,203 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,205 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,207 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,208 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml' 2025-11-27T00:44:19,210 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,211 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml' 2025-11-27T00:44:19,213 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,214 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,216 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,217 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml' 2025-11-27T00:44:19,218 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml' 2025-11-27T00:44:19,220 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,221 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,222 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,224 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,225 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml' 2025-11-27T00:44:19,227 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml' 2025-11-27T00:44:19,228 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml' 2025-11-27T00:44:19,229 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,231 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml' 2025-11-27T00:44:19,233 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,234 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,236 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml' 2025-11-27T00:44:19,238 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml' 2025-11-27T00:44:19,239 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml' 2025-11-27T00:44:19,240 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,242 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml' 2025-11-27T00:44:19,243 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml' 2025-11-27T00:44:19,246 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml' 2025-11-27T00:44:19,247 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml' 2025-11-27T00:44:19,248 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,249 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml' 2025-11-27T00:44:19,250 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml' 2025-11-27T00:44:19,251 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,252 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,253 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml' 2025-11-27T00:44:19,254 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,255 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,256 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,258 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,259 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml' 2025-11-27T00:44:19,260 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml' 2025-11-27T00:44:19,261 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,262 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml' 2025-11-27T00:44:19,263 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,264 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,266 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,267 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml' 2025-11-27T00:44:19,268 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,269 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,270 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,271 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,272 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,273 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,275 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,276 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,277 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,278 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,279 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,280 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,282 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,283 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,284 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml' 2025-11-27T00:44:19,285 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,286 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml' 2025-11-27T00:44:19,287 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,288 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,290 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,291 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml' 2025-11-27T00:44:19,292 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml' 2025-11-27T00:44:19,293 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,294 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,295 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,296 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,298 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml' 2025-11-27T00:44:19,299 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml' 2025-11-27T00:44:19,300 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml' 2025-11-27T00:44:19,301 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,302 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml' 2025-11-27T00:44:19,303 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,304 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,306 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml' 2025-11-27T00:44:19,307 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml' 2025-11-27T00:44:19,308 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml' 2025-11-27T00:44:19,309 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,310 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml' 2025-11-27T00:44:19,311 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml' 2025-11-27T00:44:19,312 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py' 2025-11-27T00:44:19,316 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml' 2025-11-27T00:44:19,317 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml' 2025-11-27T00:44:19,318 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,320 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml' 2025-11-27T00:44:19,321 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml' 2025-11-27T00:44:19,322 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,323 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,324 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml' 2025-11-27T00:44:19,325 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,326 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,328 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,329 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,330 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml' 2025-11-27T00:44:19,331 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml' 2025-11-27T00:44:19,332 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,334 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml' 2025-11-27T00:44:19,335 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,336 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,337 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,338 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml' 2025-11-27T00:44:19,339 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,341 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,342 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,343 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,344 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,345 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,346 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,348 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,349 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,350 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,351 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,352 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,353 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,355 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,356 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml' 2025-11-27T00:44:19,357 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,358 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml' 2025-11-27T00:44:19,359 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,360 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,361 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,363 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml' 2025-11-27T00:44:19,364 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml' 2025-11-27T00:44:19,365 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,366 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,367 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,368 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,370 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml' 2025-11-27T00:44:19,371 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml' 2025-11-27T00:44:19,372 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml' 2025-11-27T00:44:19,373 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,374 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml' 2025-11-27T00:44:19,375 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,377 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,378 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml' 2025-11-27T00:44:19,379 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml' 2025-11-27T00:44:19,380 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml' 2025-11-27T00:44:19,381 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,383 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml' 2025-11-27T00:44:19,384 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml' 2025-11-27T00:44:19,385 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py' 2025-11-27T00:44:19,388 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml' 2025-11-27T00:44:19,389 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml' 2025-11-27T00:44:19,390 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,391 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml' 2025-11-27T00:44:19,392 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml' 2025-11-27T00:44:19,393 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,395 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,396 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml' 2025-11-27T00:44:19,397 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,398 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,399 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,400 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,401 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml' 2025-11-27T00:44:19,403 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml' 2025-11-27T00:44:19,404 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,405 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml' 2025-11-27T00:44:19,406 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,407 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,408 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,409 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml' 2025-11-27T00:44:19,411 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,412 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,413 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,414 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,415 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,416 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,418 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,419 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,420 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,421 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,422 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,423 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,425 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,426 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,427 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml' 2025-11-27T00:44:19,428 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,430 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml' 2025-11-27T00:44:19,431 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,432 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,433 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,434 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml' 2025-11-27T00:44:19,435 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml' 2025-11-27T00:44:19,436 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,437 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,438 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,439 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,441 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml' 2025-11-27T00:44:19,442 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml' 2025-11-27T00:44:19,443 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml' 2025-11-27T00:44:19,444 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,445 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml' 2025-11-27T00:44:19,446 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,447 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,449 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml' 2025-11-27T00:44:19,450 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml' 2025-11-27T00:44:19,451 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml' 2025-11-27T00:44:19,452 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,453 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml' 2025-11-27T00:44:19,454 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml' 2025-11-27T00:44:19,457 adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml' 2025-11-27T00:44:19,458 adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml' 2025-11-27T00:44:19,460 adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,461 adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml' 2025-11-27T00:44:19,462 adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml' 2025-11-27T00:44:19,463 adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,464 adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,465 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml' 2025-11-27T00:44:19,467 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,468 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,469 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,470 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,471 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml' 2025-11-27T00:44:19,472 adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml' 2025-11-27T00:44:19,474 adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,475 adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml' 2025-11-27T00:44:19,476 adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,477 adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,478 adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,480 adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml' 2025-11-27T00:44:19,481 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,482 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,483 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,484 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,485 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,486 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,487 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,488 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,490 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,491 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,492 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,493 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,494 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,495 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,497 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml' 2025-11-27T00:44:19,498 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,499 adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml' 2025-11-27T00:44:19,500 adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,501 adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,502 adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,504 adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml' 2025-11-27T00:44:19,505 adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml' 2025-11-27T00:44:19,506 adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,507 adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,508 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,510 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,511 adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml' 2025-11-27T00:44:19,512 adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml' 2025-11-27T00:44:19,513 adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml' 2025-11-27T00:44:19,514 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,516 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml' 2025-11-27T00:44:19,517 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,518 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,519 adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml' 2025-11-27T00:44:19,520 adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml' 2025-11-27T00:44:19,522 adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml' 2025-11-27T00:44:19,523 adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,524 adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml' 2025-11-27T00:44:19,525 adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml' 2025-11-27T00:44:19,527 adding 'lm_eval/tasks/mmlu-pro-plus/README.md' 2025-11-27T00:44:19,529 adding 'lm_eval/tasks/mmlu-pro-plus/_default_template_yaml' 2025-11-27T00:44:19,530 adding 'lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml' 2025-11-27T00:44:19,531 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml' 2025-11-27T00:44:19,532 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml' 2025-11-27T00:44:19,534 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml' 2025-11-27T00:44:19,535 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml' 2025-11-27T00:44:19,536 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml' 2025-11-27T00:44:19,537 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml' 2025-11-27T00:44:19,538 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml' 2025-11-27T00:44:19,539 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml' 2025-11-27T00:44:19,540 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml' 2025-11-27T00:44:19,541 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml' 2025-11-27T00:44:19,542 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml' 2025-11-27T00:44:19,544 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml' 2025-11-27T00:44:19,545 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml' 2025-11-27T00:44:19,546 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml' 2025-11-27T00:44:19,547 adding 'lm_eval/tasks/mmlu-pro-plus/utils.py' 2025-11-27T00:44:19,551 adding 'lm_eval/tasks/mmlu-redux/generative/README.md' 2025-11-27T00:44:19,552 adding 'lm_eval/tasks/mmlu-redux/generative/_default_template_yaml' 2025-11-27T00:44:19,553 adding 'lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml' 2025-11-27T00:44:19,554 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,555 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml' 2025-11-27T00:44:19,556 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml' 2025-11-27T00:44:19,557 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,559 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,560 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml' 2025-11-27T00:44:19,561 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,563 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,564 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,566 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,567 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml' 2025-11-27T00:44:19,568 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml' 2025-11-27T00:44:19,570 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,571 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml' 2025-11-27T00:44:19,572 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,573 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,574 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,575 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml' 2025-11-27T00:44:19,577 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,578 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,579 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,580 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,581 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,583 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,584 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,585 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,586 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,587 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,589 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,590 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,591 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,592 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,593 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml' 2025-11-27T00:44:19,594 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,595 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml' 2025-11-27T00:44:19,596 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,597 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,599 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,600 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml' 2025-11-27T00:44:19,601 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml' 2025-11-27T00:44:19,602 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,604 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,605 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,606 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,608 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml' 2025-11-27T00:44:19,610 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml' 2025-11-27T00:44:19,611 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml' 2025-11-27T00:44:19,612 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,613 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml' 2025-11-27T00:44:19,614 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,616 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,617 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml' 2025-11-27T00:44:19,618 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml' 2025-11-27T00:44:19,619 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml' 2025-11-27T00:44:19,620 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,622 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml' 2025-11-27T00:44:19,623 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml' 2025-11-27T00:44:19,625 adding 'lm_eval/tasks/mmlu-redux-spanish/README.md' 2025-11-27T00:44:19,626 adding 'lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml' 2025-11-27T00:44:19,629 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml' 2025-11-27T00:44:19,630 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml' 2025-11-27T00:44:19,631 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml' 2025-11-27T00:44:19,633 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml' 2025-11-27T00:44:19,634 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml' 2025-11-27T00:44:19,635 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml' 2025-11-27T00:44:19,636 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml' 2025-11-27T00:44:19,637 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml' 2025-11-27T00:44:19,639 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml' 2025-11-27T00:44:19,640 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml' 2025-11-27T00:44:19,641 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml' 2025-11-27T00:44:19,643 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml' 2025-11-27T00:44:19,644 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml' 2025-11-27T00:44:19,645 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml' 2025-11-27T00:44:19,646 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml' 2025-11-27T00:44:19,647 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml' 2025-11-27T00:44:19,649 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml' 2025-11-27T00:44:19,650 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml' 2025-11-27T00:44:19,651 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml' 2025-11-27T00:44:19,653 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml' 2025-11-27T00:44:19,655 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml' 2025-11-27T00:44:19,656 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml' 2025-11-27T00:44:19,657 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml' 2025-11-27T00:44:19,658 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml' 2025-11-27T00:44:19,659 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml' 2025-11-27T00:44:19,660 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml' 2025-11-27T00:44:19,662 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml' 2025-11-27T00:44:19,663 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml' 2025-11-27T00:44:19,664 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml' 2025-11-27T00:44:19,665 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml' 2025-11-27T00:44:19,666 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml' 2025-11-27T00:44:19,667 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml' 2025-11-27T00:44:19,669 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml' 2025-11-27T00:44:19,670 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml' 2025-11-27T00:44:19,671 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml' 2025-11-27T00:44:19,672 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml' 2025-11-27T00:44:19,673 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml' 2025-11-27T00:44:19,674 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml' 2025-11-27T00:44:19,676 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml' 2025-11-27T00:44:19,677 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml' 2025-11-27T00:44:19,678 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml' 2025-11-27T00:44:19,679 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml' 2025-11-27T00:44:19,681 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml' 2025-11-27T00:44:19,682 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml' 2025-11-27T00:44:19,683 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml' 2025-11-27T00:44:19,684 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml' 2025-11-27T00:44:19,685 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml' 2025-11-27T00:44:19,687 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml' 2025-11-27T00:44:19,688 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml' 2025-11-27T00:44:19,689 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml' 2025-11-27T00:44:19,690 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml' 2025-11-27T00:44:19,691 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml' 2025-11-27T00:44:19,692 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml' 2025-11-27T00:44:19,693 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml' 2025-11-27T00:44:19,694 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml' 2025-11-27T00:44:19,695 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml' 2025-11-27T00:44:19,696 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml' 2025-11-27T00:44:19,697 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml' 2025-11-27T00:44:19,699 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml' 2025-11-27T00:44:19,701 adding 'lm_eval/tasks/mmlu_pro/README.md' 2025-11-27T00:44:19,702 adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml' 2025-11-27T00:44:19,703 adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml' 2025-11-27T00:44:19,704 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml' 2025-11-27T00:44:19,705 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml' 2025-11-27T00:44:19,706 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml' 2025-11-27T00:44:19,707 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml' 2025-11-27T00:44:19,709 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml' 2025-11-27T00:44:19,710 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml' 2025-11-27T00:44:19,711 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml' 2025-11-27T00:44:19,712 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml' 2025-11-27T00:44:19,714 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml' 2025-11-27T00:44:19,715 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml' 2025-11-27T00:44:19,716 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml' 2025-11-27T00:44:19,717 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml' 2025-11-27T00:44:19,718 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml' 2025-11-27T00:44:19,720 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml' 2025-11-27T00:44:19,721 adding 'lm_eval/tasks/mmlu_pro/utils.py' 2025-11-27T00:44:19,723 adding 'lm_eval/tasks/mmlu_prox/README.md' 2025-11-27T00:44:19,727 adding 'lm_eval/tasks/mmlu_prox/lang_libs.py' 2025-11-27T00:44:19,728 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py' 2025-11-27T00:44:19,730 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py' 2025-11-27T00:44:19,732 adding 'lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml' 2025-11-27T00:44:19,733 adding 'lm_eval/tasks/mmlu_prox/af/_af_template_yaml' 2025-11-27T00:44:19,735 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml' 2025-11-27T00:44:19,736 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml' 2025-11-27T00:44:19,737 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml' 2025-11-27T00:44:19,738 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml' 2025-11-27T00:44:19,740 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml' 2025-11-27T00:44:19,741 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml' 2025-11-27T00:44:19,742 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml' 2025-11-27T00:44:19,743 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml' 2025-11-27T00:44:19,744 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml' 2025-11-27T00:44:19,746 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml' 2025-11-27T00:44:19,747 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml' 2025-11-27T00:44:19,748 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml' 2025-11-27T00:44:19,749 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml' 2025-11-27T00:44:19,750 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml' 2025-11-27T00:44:19,751 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml' 2025-11-27T00:44:19,753 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml' 2025-11-27T00:44:19,754 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml' 2025-11-27T00:44:19,755 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml' 2025-11-27T00:44:19,756 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml' 2025-11-27T00:44:19,757 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml' 2025-11-27T00:44:19,758 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml' 2025-11-27T00:44:19,759 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml' 2025-11-27T00:44:19,760 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml' 2025-11-27T00:44:19,762 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml' 2025-11-27T00:44:19,763 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml' 2025-11-27T00:44:19,764 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml' 2025-11-27T00:44:19,765 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml' 2025-11-27T00:44:19,766 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml' 2025-11-27T00:44:19,767 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml' 2025-11-27T00:44:19,768 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml' 2025-11-27T00:44:19,770 adding 'lm_eval/tasks/mmlu_prox/af/utils.py' 2025-11-27T00:44:19,772 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml' 2025-11-27T00:44:19,773 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml' 2025-11-27T00:44:19,774 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml' 2025-11-27T00:44:19,776 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml' 2025-11-27T00:44:19,777 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml' 2025-11-27T00:44:19,778 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml' 2025-11-27T00:44:19,779 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml' 2025-11-27T00:44:19,781 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml' 2025-11-27T00:44:19,782 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml' 2025-11-27T00:44:19,783 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml' 2025-11-27T00:44:19,784 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml' 2025-11-27T00:44:19,785 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml' 2025-11-27T00:44:19,787 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml' 2025-11-27T00:44:19,788 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml' 2025-11-27T00:44:19,789 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml' 2025-11-27T00:44:19,790 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml' 2025-11-27T00:44:19,791 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml' 2025-11-27T00:44:19,793 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml' 2025-11-27T00:44:19,794 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml' 2025-11-27T00:44:19,795 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml' 2025-11-27T00:44:19,796 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml' 2025-11-27T00:44:19,798 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml' 2025-11-27T00:44:19,799 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml' 2025-11-27T00:44:19,800 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml' 2025-11-27T00:44:19,801 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml' 2025-11-27T00:44:19,803 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml' 2025-11-27T00:44:19,804 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml' 2025-11-27T00:44:19,805 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml' 2025-11-27T00:44:19,806 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml' 2025-11-27T00:44:19,807 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml' 2025-11-27T00:44:19,808 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml' 2025-11-27T00:44:19,809 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml' 2025-11-27T00:44:19,810 adding 'lm_eval/tasks/mmlu_prox/ar/utils.py' 2025-11-27T00:44:19,813 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml' 2025-11-27T00:44:19,814 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml' 2025-11-27T00:44:19,815 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml' 2025-11-27T00:44:19,816 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml' 2025-11-27T00:44:19,817 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml' 2025-11-27T00:44:19,818 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml' 2025-11-27T00:44:19,820 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml' 2025-11-27T00:44:19,821 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml' 2025-11-27T00:44:19,822 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml' 2025-11-27T00:44:19,823 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml' 2025-11-27T00:44:19,824 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml' 2025-11-27T00:44:19,825 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml' 2025-11-27T00:44:19,827 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml' 2025-11-27T00:44:19,828 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml' 2025-11-27T00:44:19,829 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml' 2025-11-27T00:44:19,830 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml' 2025-11-27T00:44:19,831 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml' 2025-11-27T00:44:19,833 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml' 2025-11-27T00:44:19,834 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml' 2025-11-27T00:44:19,835 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml' 2025-11-27T00:44:19,836 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml' 2025-11-27T00:44:19,838 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml' 2025-11-27T00:44:19,839 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml' 2025-11-27T00:44:19,840 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml' 2025-11-27T00:44:19,841 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml' 2025-11-27T00:44:19,843 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml' 2025-11-27T00:44:19,844 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml' 2025-11-27T00:44:19,845 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml' 2025-11-27T00:44:19,846 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml' 2025-11-27T00:44:19,847 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml' 2025-11-27T00:44:19,849 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml' 2025-11-27T00:44:19,850 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml' 2025-11-27T00:44:19,851 adding 'lm_eval/tasks/mmlu_prox/bn/utils.py' 2025-11-27T00:44:19,854 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml' 2025-11-27T00:44:19,855 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml' 2025-11-27T00:44:19,856 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml' 2025-11-27T00:44:19,858 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml' 2025-11-27T00:44:19,859 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml' 2025-11-27T00:44:19,860 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml' 2025-11-27T00:44:19,861 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml' 2025-11-27T00:44:19,862 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml' 2025-11-27T00:44:19,863 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml' 2025-11-27T00:44:19,865 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml' 2025-11-27T00:44:19,866 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml' 2025-11-27T00:44:19,867 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml' 2025-11-27T00:44:19,868 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml' 2025-11-27T00:44:19,869 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml' 2025-11-27T00:44:19,870 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml' 2025-11-27T00:44:19,872 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml' 2025-11-27T00:44:19,873 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml' 2025-11-27T00:44:19,874 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml' 2025-11-27T00:44:19,875 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml' 2025-11-27T00:44:19,877 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml' 2025-11-27T00:44:19,878 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml' 2025-11-27T00:44:19,879 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml' 2025-11-27T00:44:19,880 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml' 2025-11-27T00:44:19,881 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml' 2025-11-27T00:44:19,882 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml' 2025-11-27T00:44:19,883 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml' 2025-11-27T00:44:19,885 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml' 2025-11-27T00:44:19,886 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml' 2025-11-27T00:44:19,888 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml' 2025-11-27T00:44:19,889 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml' 2025-11-27T00:44:19,890 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml' 2025-11-27T00:44:19,891 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml' 2025-11-27T00:44:19,893 adding 'lm_eval/tasks/mmlu_prox/cs/utils.py' 2025-11-27T00:44:19,895 adding 'lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml' 2025-11-27T00:44:19,896 adding 'lm_eval/tasks/mmlu_prox/de/_de_template_yaml' 2025-11-27T00:44:19,897 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml' 2025-11-27T00:44:19,899 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml' 2025-11-27T00:44:19,900 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml' 2025-11-27T00:44:19,901 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml' 2025-11-27T00:44:19,902 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml' 2025-11-27T00:44:19,903 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml' 2025-11-27T00:44:19,905 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml' 2025-11-27T00:44:19,906 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml' 2025-11-27T00:44:19,907 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml' 2025-11-27T00:44:19,908 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml' 2025-11-27T00:44:19,910 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml' 2025-11-27T00:44:19,911 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml' 2025-11-27T00:44:19,912 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml' 2025-11-27T00:44:19,913 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml' 2025-11-27T00:44:19,914 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml' 2025-11-27T00:44:19,916 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml' 2025-11-27T00:44:19,917 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml' 2025-11-27T00:44:19,918 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml' 2025-11-27T00:44:19,919 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml' 2025-11-27T00:44:19,920 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml' 2025-11-27T00:44:19,921 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml' 2025-11-27T00:44:19,922 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml' 2025-11-27T00:44:19,923 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml' 2025-11-27T00:44:19,924 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml' 2025-11-27T00:44:19,925 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml' 2025-11-27T00:44:19,927 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml' 2025-11-27T00:44:19,928 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml' 2025-11-27T00:44:19,929 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml' 2025-11-27T00:44:19,930 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml' 2025-11-27T00:44:19,931 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml' 2025-11-27T00:44:19,932 adding 'lm_eval/tasks/mmlu_prox/de/utils.py' 2025-11-27T00:44:19,935 adding 'lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml' 2025-11-27T00:44:19,936 adding 'lm_eval/tasks/mmlu_prox/en/_en_template_yaml' 2025-11-27T00:44:19,937 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml' 2025-11-27T00:44:19,938 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml' 2025-11-27T00:44:19,939 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml' 2025-11-27T00:44:19,941 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml' 2025-11-27T00:44:19,942 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml' 2025-11-27T00:44:19,943 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml' 2025-11-27T00:44:19,944 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml' 2025-11-27T00:44:19,945 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml' 2025-11-27T00:44:19,947 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml' 2025-11-27T00:44:19,948 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml' 2025-11-27T00:44:19,949 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml' 2025-11-27T00:44:19,950 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml' 2025-11-27T00:44:19,951 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml' 2025-11-27T00:44:19,952 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml' 2025-11-27T00:44:19,954 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml' 2025-11-27T00:44:19,955 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml' 2025-11-27T00:44:19,956 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml' 2025-11-27T00:44:19,957 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml' 2025-11-27T00:44:19,959 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml' 2025-11-27T00:44:19,960 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml' 2025-11-27T00:44:19,961 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml' 2025-11-27T00:44:19,962 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml' 2025-11-27T00:44:19,963 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml' 2025-11-27T00:44:19,965 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml' 2025-11-27T00:44:19,966 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml' 2025-11-27T00:44:19,967 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml' 2025-11-27T00:44:19,969 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml' 2025-11-27T00:44:19,970 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml' 2025-11-27T00:44:19,971 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml' 2025-11-27T00:44:19,972 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml' 2025-11-27T00:44:19,974 adding 'lm_eval/tasks/mmlu_prox/en/utils.py' 2025-11-27T00:44:19,976 adding 'lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml' 2025-11-27T00:44:19,977 adding 'lm_eval/tasks/mmlu_prox/es/_es_template_yaml' 2025-11-27T00:44:19,979 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml' 2025-11-27T00:44:19,980 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml' 2025-11-27T00:44:19,981 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml' 2025-11-27T00:44:19,982 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml' 2025-11-27T00:44:19,983 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml' 2025-11-27T00:44:19,984 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml' 2025-11-27T00:44:19,986 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml' 2025-11-27T00:44:19,987 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml' 2025-11-27T00:44:19,988 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml' 2025-11-27T00:44:19,990 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml' 2025-11-27T00:44:19,991 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml' 2025-11-27T00:44:19,992 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml' 2025-11-27T00:44:19,993 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml' 2025-11-27T00:44:19,994 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml' 2025-11-27T00:44:19,996 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml' 2025-11-27T00:44:19,997 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml' 2025-11-27T00:44:19,998 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml' 2025-11-27T00:44:19,999 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml' 2025-11-27T00:44:20,000 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml' 2025-11-27T00:44:20,001 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml' 2025-11-27T00:44:20,003 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml' 2025-11-27T00:44:20,004 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml' 2025-11-27T00:44:20,005 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml' 2025-11-27T00:44:20,006 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml' 2025-11-27T00:44:20,007 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml' 2025-11-27T00:44:20,009 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml' 2025-11-27T00:44:20,010 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml' 2025-11-27T00:44:20,011 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml' 2025-11-27T00:44:20,012 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml' 2025-11-27T00:44:20,013 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml' 2025-11-27T00:44:20,015 adding 'lm_eval/tasks/mmlu_prox/es/utils.py' 2025-11-27T00:44:20,017 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml' 2025-11-27T00:44:20,018 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml' 2025-11-27T00:44:20,020 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml' 2025-11-27T00:44:20,021 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml' 2025-11-27T00:44:20,022 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml' 2025-11-27T00:44:20,023 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml' 2025-11-27T00:44:20,024 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml' 2025-11-27T00:44:20,026 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml' 2025-11-27T00:44:20,027 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml' 2025-11-27T00:44:20,028 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml' 2025-11-27T00:44:20,029 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml' 2025-11-27T00:44:20,030 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml' 2025-11-27T00:44:20,031 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml' 2025-11-27T00:44:20,033 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml' 2025-11-27T00:44:20,034 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml' 2025-11-27T00:44:20,035 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml' 2025-11-27T00:44:20,036 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml' 2025-11-27T00:44:20,037 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml' 2025-11-27T00:44:20,038 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml' 2025-11-27T00:44:20,039 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml' 2025-11-27T00:44:20,041 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml' 2025-11-27T00:44:20,042 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml' 2025-11-27T00:44:20,043 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml' 2025-11-27T00:44:20,044 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml' 2025-11-27T00:44:20,045 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml' 2025-11-27T00:44:20,046 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml' 2025-11-27T00:44:20,047 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml' 2025-11-27T00:44:20,049 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml' 2025-11-27T00:44:20,050 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml' 2025-11-27T00:44:20,051 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml' 2025-11-27T00:44:20,052 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml' 2025-11-27T00:44:20,053 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml' 2025-11-27T00:44:20,055 adding 'lm_eval/tasks/mmlu_prox/fr/utils.py' 2025-11-27T00:44:20,057 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml' 2025-11-27T00:44:20,058 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml' 2025-11-27T00:44:20,059 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml' 2025-11-27T00:44:20,061 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml' 2025-11-27T00:44:20,062 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml' 2025-11-27T00:44:20,063 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml' 2025-11-27T00:44:20,064 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml' 2025-11-27T00:44:20,065 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml' 2025-11-27T00:44:20,067 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml' 2025-11-27T00:44:20,068 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml' 2025-11-27T00:44:20,069 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml' 2025-11-27T00:44:20,070 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml' 2025-11-27T00:44:20,071 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml' 2025-11-27T00:44:20,073 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml' 2025-11-27T00:44:20,074 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml' 2025-11-27T00:44:20,075 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml' 2025-11-27T00:44:20,076 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml' 2025-11-27T00:44:20,078 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml' 2025-11-27T00:44:20,079 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml' 2025-11-27T00:44:20,080 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml' 2025-11-27T00:44:20,081 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml' 2025-11-27T00:44:20,083 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml' 2025-11-27T00:44:20,084 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml' 2025-11-27T00:44:20,085 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml' 2025-11-27T00:44:20,086 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml' 2025-11-27T00:44:20,087 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml' 2025-11-27T00:44:20,089 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml' 2025-11-27T00:44:20,090 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml' 2025-11-27T00:44:20,091 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml' 2025-11-27T00:44:20,092 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml' 2025-11-27T00:44:20,093 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml' 2025-11-27T00:44:20,095 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml' 2025-11-27T00:44:20,096 adding 'lm_eval/tasks/mmlu_prox/hi/utils.py' 2025-11-27T00:44:20,098 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml' 2025-11-27T00:44:20,099 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml' 2025-11-27T00:44:20,101 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml' 2025-11-27T00:44:20,102 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml' 2025-11-27T00:44:20,103 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml' 2025-11-27T00:44:20,104 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml' 2025-11-27T00:44:20,106 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml' 2025-11-27T00:44:20,107 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml' 2025-11-27T00:44:20,108 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml' 2025-11-27T00:44:20,109 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml' 2025-11-27T00:44:20,110 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml' 2025-11-27T00:44:20,112 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml' 2025-11-27T00:44:20,113 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml' 2025-11-27T00:44:20,114 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml' 2025-11-27T00:44:20,115 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml' 2025-11-27T00:44:20,116 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml' 2025-11-27T00:44:20,118 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml' 2025-11-27T00:44:20,119 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml' 2025-11-27T00:44:20,120 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml' 2025-11-27T00:44:20,121 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml' 2025-11-27T00:44:20,123 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml' 2025-11-27T00:44:20,124 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml' 2025-11-27T00:44:20,125 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml' 2025-11-27T00:44:20,126 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml' 2025-11-27T00:44:20,127 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml' 2025-11-27T00:44:20,129 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml' 2025-11-27T00:44:20,130 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml' 2025-11-27T00:44:20,131 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml' 2025-11-27T00:44:20,132 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml' 2025-11-27T00:44:20,134 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml' 2025-11-27T00:44:20,135 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml' 2025-11-27T00:44:20,136 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml' 2025-11-27T00:44:20,137 adding 'lm_eval/tasks/mmlu_prox/hu/utils.py' 2025-11-27T00:44:20,140 adding 'lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml' 2025-11-27T00:44:20,141 adding 'lm_eval/tasks/mmlu_prox/id/_id_template_yaml' 2025-11-27T00:44:20,142 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml' 2025-11-27T00:44:20,143 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml' 2025-11-27T00:44:20,144 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml' 2025-11-27T00:44:20,145 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml' 2025-11-27T00:44:20,147 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml' 2025-11-27T00:44:20,148 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml' 2025-11-27T00:44:20,149 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml' 2025-11-27T00:44:20,150 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml' 2025-11-27T00:44:20,151 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml' 2025-11-27T00:44:20,152 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml' 2025-11-27T00:44:20,153 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml' 2025-11-27T00:44:20,154 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml' 2025-11-27T00:44:20,156 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml' 2025-11-27T00:44:20,157 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml' 2025-11-27T00:44:20,158 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml' 2025-11-27T00:44:20,159 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml' 2025-11-27T00:44:20,160 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml' 2025-11-27T00:44:20,161 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml' 2025-11-27T00:44:20,163 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml' 2025-11-27T00:44:20,164 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml' 2025-11-27T00:44:20,165 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml' 2025-11-27T00:44:20,166 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml' 2025-11-27T00:44:20,167 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml' 2025-11-27T00:44:20,169 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml' 2025-11-27T00:44:20,170 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml' 2025-11-27T00:44:20,171 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml' 2025-11-27T00:44:20,172 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml' 2025-11-27T00:44:20,174 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml' 2025-11-27T00:44:20,175 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml' 2025-11-27T00:44:20,176 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml' 2025-11-27T00:44:20,177 adding 'lm_eval/tasks/mmlu_prox/id/utils.py' 2025-11-27T00:44:20,180 adding 'lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml' 2025-11-27T00:44:20,181 adding 'lm_eval/tasks/mmlu_prox/it/_it_template_yaml' 2025-11-27T00:44:20,182 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml' 2025-11-27T00:44:20,183 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml' 2025-11-27T00:44:20,185 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml' 2025-11-27T00:44:20,186 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml' 2025-11-27T00:44:20,187 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml' 2025-11-27T00:44:20,188 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml' 2025-11-27T00:44:20,190 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml' 2025-11-27T00:44:20,191 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml' 2025-11-27T00:44:20,192 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml' 2025-11-27T00:44:20,193 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml' 2025-11-27T00:44:20,195 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml' 2025-11-27T00:44:20,196 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml' 2025-11-27T00:44:20,197 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml' 2025-11-27T00:44:20,199 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml' 2025-11-27T00:44:20,200 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml' 2025-11-27T00:44:20,201 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml' 2025-11-27T00:44:20,202 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml' 2025-11-27T00:44:20,203 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml' 2025-11-27T00:44:20,205 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml' 2025-11-27T00:44:20,206 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml' 2025-11-27T00:44:20,207 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml' 2025-11-27T00:44:20,208 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml' 2025-11-27T00:44:20,209 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml' 2025-11-27T00:44:20,210 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml' 2025-11-27T00:44:20,212 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml' 2025-11-27T00:44:20,213 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml' 2025-11-27T00:44:20,214 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml' 2025-11-27T00:44:20,215 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml' 2025-11-27T00:44:20,216 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml' 2025-11-27T00:44:20,217 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml' 2025-11-27T00:44:20,219 adding 'lm_eval/tasks/mmlu_prox/it/utils.py' 2025-11-27T00:44:20,221 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml' 2025-11-27T00:44:20,222 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml' 2025-11-27T00:44:20,224 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml' 2025-11-27T00:44:20,225 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml' 2025-11-27T00:44:20,226 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml' 2025-11-27T00:44:20,227 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml' 2025-11-27T00:44:20,229 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml' 2025-11-27T00:44:20,230 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml' 2025-11-27T00:44:20,231 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml' 2025-11-27T00:44:20,233 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml' 2025-11-27T00:44:20,234 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml' 2025-11-27T00:44:20,235 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml' 2025-11-27T00:44:20,237 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml' 2025-11-27T00:44:20,238 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml' 2025-11-27T00:44:20,239 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml' 2025-11-27T00:44:20,240 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml' 2025-11-27T00:44:20,242 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml' 2025-11-27T00:44:20,243 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml' 2025-11-27T00:44:20,244 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml' 2025-11-27T00:44:20,245 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml' 2025-11-27T00:44:20,246 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml' 2025-11-27T00:44:20,248 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml' 2025-11-27T00:44:20,249 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml' 2025-11-27T00:44:20,250 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml' 2025-11-27T00:44:20,251 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml' 2025-11-27T00:44:20,253 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml' 2025-11-27T00:44:20,254 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml' 2025-11-27T00:44:20,255 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml' 2025-11-27T00:44:20,257 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml' 2025-11-27T00:44:20,258 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml' 2025-11-27T00:44:20,259 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml' 2025-11-27T00:44:20,260 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml' 2025-11-27T00:44:20,261 adding 'lm_eval/tasks/mmlu_prox/ja/utils.py' 2025-11-27T00:44:20,263 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml' 2025-11-27T00:44:20,265 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml' 2025-11-27T00:44:20,266 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml' 2025-11-27T00:44:20,267 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml' 2025-11-27T00:44:20,268 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml' 2025-11-27T00:44:20,269 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml' 2025-11-27T00:44:20,271 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml' 2025-11-27T00:44:20,272 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml' 2025-11-27T00:44:20,273 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml' 2025-11-27T00:44:20,274 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml' 2025-11-27T00:44:20,275 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml' 2025-11-27T00:44:20,276 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml' 2025-11-27T00:44:20,277 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml' 2025-11-27T00:44:20,279 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml' 2025-11-27T00:44:20,280 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml' 2025-11-27T00:44:20,281 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml' 2025-11-27T00:44:20,282 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml' 2025-11-27T00:44:20,284 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml' 2025-11-27T00:44:20,285 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml' 2025-11-27T00:44:20,286 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml' 2025-11-27T00:44:20,287 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml' 2025-11-27T00:44:20,288 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml' 2025-11-27T00:44:20,290 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml' 2025-11-27T00:44:20,291 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml' 2025-11-27T00:44:20,292 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml' 2025-11-27T00:44:20,293 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml' 2025-11-27T00:44:20,295 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml' 2025-11-27T00:44:20,296 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml' 2025-11-27T00:44:20,297 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml' 2025-11-27T00:44:20,298 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml' 2025-11-27T00:44:20,300 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml' 2025-11-27T00:44:20,301 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml' 2025-11-27T00:44:20,302 adding 'lm_eval/tasks/mmlu_prox/ko/utils.py' 2025-11-27T00:44:20,305 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml' 2025-11-27T00:44:20,306 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml' 2025-11-27T00:44:20,307 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml' 2025-11-27T00:44:20,308 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml' 2025-11-27T00:44:20,310 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml' 2025-11-27T00:44:20,311 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml' 2025-11-27T00:44:20,312 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml' 2025-11-27T00:44:20,313 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml' 2025-11-27T00:44:20,314 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml' 2025-11-27T00:44:20,315 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml' 2025-11-27T00:44:20,317 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml' 2025-11-27T00:44:20,318 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml' 2025-11-27T00:44:20,319 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml' 2025-11-27T00:44:20,320 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml' 2025-11-27T00:44:20,321 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml' 2025-11-27T00:44:20,322 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml' 2025-11-27T00:44:20,323 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml' 2025-11-27T00:44:20,324 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml' 2025-11-27T00:44:20,326 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml' 2025-11-27T00:44:20,327 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml' 2025-11-27T00:44:20,328 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml' 2025-11-27T00:44:20,329 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml' 2025-11-27T00:44:20,330 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml' 2025-11-27T00:44:20,332 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml' 2025-11-27T00:44:20,333 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml' 2025-11-27T00:44:20,334 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml' 2025-11-27T00:44:20,335 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml' 2025-11-27T00:44:20,336 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml' 2025-11-27T00:44:20,337 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml' 2025-11-27T00:44:20,339 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml' 2025-11-27T00:44:20,340 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml' 2025-11-27T00:44:20,341 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml' 2025-11-27T00:44:20,342 adding 'lm_eval/tasks/mmlu_prox/mr/utils.py' 2025-11-27T00:44:20,345 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml' 2025-11-27T00:44:20,346 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml' 2025-11-27T00:44:20,347 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml' 2025-11-27T00:44:20,349 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml' 2025-11-27T00:44:20,350 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml' 2025-11-27T00:44:20,351 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml' 2025-11-27T00:44:20,352 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml' 2025-11-27T00:44:20,354 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml' 2025-11-27T00:44:20,355 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml' 2025-11-27T00:44:20,356 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml' 2025-11-27T00:44:20,357 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml' 2025-11-27T00:44:20,359 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml' 2025-11-27T00:44:20,360 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml' 2025-11-27T00:44:20,361 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml' 2025-11-27T00:44:20,362 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml' 2025-11-27T00:44:20,364 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml' 2025-11-27T00:44:20,365 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml' 2025-11-27T00:44:20,366 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml' 2025-11-27T00:44:20,367 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml' 2025-11-27T00:44:20,369 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml' 2025-11-27T00:44:20,370 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml' 2025-11-27T00:44:20,371 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml' 2025-11-27T00:44:20,372 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml' 2025-11-27T00:44:20,373 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml' 2025-11-27T00:44:20,374 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml' 2025-11-27T00:44:20,375 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml' 2025-11-27T00:44:20,377 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml' 2025-11-27T00:44:20,378 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml' 2025-11-27T00:44:20,379 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml' 2025-11-27T00:44:20,380 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml' 2025-11-27T00:44:20,381 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml' 2025-11-27T00:44:20,383 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml' 2025-11-27T00:44:20,384 adding 'lm_eval/tasks/mmlu_prox/ne/utils.py' 2025-11-27T00:44:20,386 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml' 2025-11-27T00:44:20,387 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml' 2025-11-27T00:44:20,388 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml' 2025-11-27T00:44:20,389 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml' 2025-11-27T00:44:20,391 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml' 2025-11-27T00:44:20,392 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml' 2025-11-27T00:44:20,393 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml' 2025-11-27T00:44:20,394 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml' 2025-11-27T00:44:20,395 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml' 2025-11-27T00:44:20,396 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml' 2025-11-27T00:44:20,398 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml' 2025-11-27T00:44:20,399 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml' 2025-11-27T00:44:20,400 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml' 2025-11-27T00:44:20,401 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml' 2025-11-27T00:44:20,402 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml' 2025-11-27T00:44:20,404 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml' 2025-11-27T00:44:20,405 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml' 2025-11-27T00:44:20,406 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml' 2025-11-27T00:44:20,407 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml' 2025-11-27T00:44:20,409 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml' 2025-11-27T00:44:20,410 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml' 2025-11-27T00:44:20,411 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml' 2025-11-27T00:44:20,412 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml' 2025-11-27T00:44:20,414 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml' 2025-11-27T00:44:20,415 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml' 2025-11-27T00:44:20,416 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml' 2025-11-27T00:44:20,417 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml' 2025-11-27T00:44:20,418 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml' 2025-11-27T00:44:20,420 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml' 2025-11-27T00:44:20,421 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml' 2025-11-27T00:44:20,422 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml' 2025-11-27T00:44:20,423 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml' 2025-11-27T00:44:20,425 adding 'lm_eval/tasks/mmlu_prox/pt/utils.py' 2025-11-27T00:44:20,427 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml' 2025-11-27T00:44:20,428 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml' 2025-11-27T00:44:20,429 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml' 2025-11-27T00:44:20,430 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml' 2025-11-27T00:44:20,432 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml' 2025-11-27T00:44:20,433 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml' 2025-11-27T00:44:20,434 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml' 2025-11-27T00:44:20,435 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml' 2025-11-27T00:44:20,436 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml' 2025-11-27T00:44:20,438 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml' 2025-11-27T00:44:20,439 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml' 2025-11-27T00:44:20,440 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml' 2025-11-27T00:44:20,441 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml' 2025-11-27T00:44:20,442 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml' 2025-11-27T00:44:20,444 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml' 2025-11-27T00:44:20,445 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml' 2025-11-27T00:44:20,446 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml' 2025-11-27T00:44:20,447 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml' 2025-11-27T00:44:20,448 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml' 2025-11-27T00:44:20,449 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml' 2025-11-27T00:44:20,451 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml' 2025-11-27T00:44:20,452 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml' 2025-11-27T00:44:20,453 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml' 2025-11-27T00:44:20,454 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml' 2025-11-27T00:44:20,455 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml' 2025-11-27T00:44:20,457 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml' 2025-11-27T00:44:20,458 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml' 2025-11-27T00:44:20,459 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml' 2025-11-27T00:44:20,460 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml' 2025-11-27T00:44:20,462 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml' 2025-11-27T00:44:20,463 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml' 2025-11-27T00:44:20,464 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml' 2025-11-27T00:44:20,466 adding 'lm_eval/tasks/mmlu_prox/ru/utils.py' 2025-11-27T00:44:20,468 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml' 2025-11-27T00:44:20,469 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml' 2025-11-27T00:44:20,470 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml' 2025-11-27T00:44:20,471 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml' 2025-11-27T00:44:20,473 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml' 2025-11-27T00:44:20,474 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml' 2025-11-27T00:44:20,475 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml' 2025-11-27T00:44:20,476 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml' 2025-11-27T00:44:20,478 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml' 2025-11-27T00:44:20,479 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml' 2025-11-27T00:44:20,480 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml' 2025-11-27T00:44:20,481 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml' 2025-11-27T00:44:20,483 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml' 2025-11-27T00:44:20,484 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml' 2025-11-27T00:44:20,485 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml' 2025-11-27T00:44:20,486 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml' 2025-11-27T00:44:20,487 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml' 2025-11-27T00:44:20,488 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml' 2025-11-27T00:44:20,489 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml' 2025-11-27T00:44:20,490 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml' 2025-11-27T00:44:20,491 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml' 2025-11-27T00:44:20,493 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml' 2025-11-27T00:44:20,494 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml' 2025-11-27T00:44:20,495 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml' 2025-11-27T00:44:20,496 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml' 2025-11-27T00:44:20,498 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml' 2025-11-27T00:44:20,499 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml' 2025-11-27T00:44:20,500 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml' 2025-11-27T00:44:20,501 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml' 2025-11-27T00:44:20,502 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml' 2025-11-27T00:44:20,503 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml' 2025-11-27T00:44:20,504 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml' 2025-11-27T00:44:20,506 adding 'lm_eval/tasks/mmlu_prox/sr/utils.py' 2025-11-27T00:44:20,508 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml' 2025-11-27T00:44:20,509 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml' 2025-11-27T00:44:20,511 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml' 2025-11-27T00:44:20,512 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml' 2025-11-27T00:44:20,513 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml' 2025-11-27T00:44:20,514 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml' 2025-11-27T00:44:20,515 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml' 2025-11-27T00:44:20,517 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml' 2025-11-27T00:44:20,518 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml' 2025-11-27T00:44:20,519 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml' 2025-11-27T00:44:20,520 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml' 2025-11-27T00:44:20,522 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml' 2025-11-27T00:44:20,523 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml' 2025-11-27T00:44:20,524 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml' 2025-11-27T00:44:20,525 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml' 2025-11-27T00:44:20,526 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml' 2025-11-27T00:44:20,528 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml' 2025-11-27T00:44:20,529 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml' 2025-11-27T00:44:20,530 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml' 2025-11-27T00:44:20,531 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml' 2025-11-27T00:44:20,533 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml' 2025-11-27T00:44:20,534 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml' 2025-11-27T00:44:20,535 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml' 2025-11-27T00:44:20,536 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml' 2025-11-27T00:44:20,538 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml' 2025-11-27T00:44:20,539 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml' 2025-11-27T00:44:20,540 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml' 2025-11-27T00:44:20,541 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml' 2025-11-27T00:44:20,542 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml' 2025-11-27T00:44:20,543 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml' 2025-11-27T00:44:20,545 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml' 2025-11-27T00:44:20,546 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml' 2025-11-27T00:44:20,547 adding 'lm_eval/tasks/mmlu_prox/sw/utils.py' 2025-11-27T00:44:20,549 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml' 2025-11-27T00:44:20,550 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml' 2025-11-27T00:44:20,551 adding 'lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml' 2025-11-27T00:44:20,553 adding 'lm_eval/tasks/mmlu_prox/te/_te_template_yaml' 2025-11-27T00:44:20,554 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml' 2025-11-27T00:44:20,555 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml' 2025-11-27T00:44:20,556 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml' 2025-11-27T00:44:20,558 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml' 2025-11-27T00:44:20,559 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml' 2025-11-27T00:44:20,560 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml' 2025-11-27T00:44:20,561 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml' 2025-11-27T00:44:20,562 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml' 2025-11-27T00:44:20,564 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml' 2025-11-27T00:44:20,565 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml' 2025-11-27T00:44:20,566 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml' 2025-11-27T00:44:20,567 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml' 2025-11-27T00:44:20,569 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml' 2025-11-27T00:44:20,570 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml' 2025-11-27T00:44:20,571 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml' 2025-11-27T00:44:20,573 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml' 2025-11-27T00:44:20,574 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml' 2025-11-27T00:44:20,575 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml' 2025-11-27T00:44:20,576 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml' 2025-11-27T00:44:20,578 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml' 2025-11-27T00:44:20,579 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml' 2025-11-27T00:44:20,580 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml' 2025-11-27T00:44:20,581 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml' 2025-11-27T00:44:20,583 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml' 2025-11-27T00:44:20,584 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml' 2025-11-27T00:44:20,585 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml' 2025-11-27T00:44:20,586 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml' 2025-11-27T00:44:20,588 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml' 2025-11-27T00:44:20,589 adding 'lm_eval/tasks/mmlu_prox/te/utils.py' 2025-11-27T00:44:20,591 adding 'lm_eval/tasks/mmlu_prox/template/_lang_template_yaml' 2025-11-27T00:44:20,592 adding 'lm_eval/tasks/mmlu_prox/template/utils.py' 2025-11-27T00:44:20,595 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml' 2025-11-27T00:44:20,596 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml' 2025-11-27T00:44:20,597 adding 'lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml' 2025-11-27T00:44:20,598 adding 'lm_eval/tasks/mmlu_prox/th/_th_template_yaml' 2025-11-27T00:44:20,600 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml' 2025-11-27T00:44:20,601 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml' 2025-11-27T00:44:20,602 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml' 2025-11-27T00:44:20,603 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml' 2025-11-27T00:44:20,604 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml' 2025-11-27T00:44:20,605 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml' 2025-11-27T00:44:20,606 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml' 2025-11-27T00:44:20,608 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml' 2025-11-27T00:44:20,609 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml' 2025-11-27T00:44:20,610 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml' 2025-11-27T00:44:20,611 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml' 2025-11-27T00:44:20,613 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml' 2025-11-27T00:44:20,614 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml' 2025-11-27T00:44:20,615 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml' 2025-11-27T00:44:20,616 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml' 2025-11-27T00:44:20,617 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml' 2025-11-27T00:44:20,618 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml' 2025-11-27T00:44:20,619 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml' 2025-11-27T00:44:20,621 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml' 2025-11-27T00:44:20,622 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml' 2025-11-27T00:44:20,623 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml' 2025-11-27T00:44:20,624 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml' 2025-11-27T00:44:20,625 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml' 2025-11-27T00:44:20,627 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml' 2025-11-27T00:44:20,628 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml' 2025-11-27T00:44:20,629 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml' 2025-11-27T00:44:20,630 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml' 2025-11-27T00:44:20,632 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml' 2025-11-27T00:44:20,633 adding 'lm_eval/tasks/mmlu_prox/th/utils.py' 2025-11-27T00:44:20,635 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml' 2025-11-27T00:44:20,636 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml' 2025-11-27T00:44:20,638 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml' 2025-11-27T00:44:20,639 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml' 2025-11-27T00:44:20,640 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml' 2025-11-27T00:44:20,641 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml' 2025-11-27T00:44:20,643 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml' 2025-11-27T00:44:20,644 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml' 2025-11-27T00:44:20,645 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml' 2025-11-27T00:44:20,646 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml' 2025-11-27T00:44:20,648 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml' 2025-11-27T00:44:20,649 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml' 2025-11-27T00:44:20,650 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml' 2025-11-27T00:44:20,651 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml' 2025-11-27T00:44:20,653 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml' 2025-11-27T00:44:20,654 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml' 2025-11-27T00:44:20,655 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml' 2025-11-27T00:44:20,656 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml' 2025-11-27T00:44:20,657 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml' 2025-11-27T00:44:20,658 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml' 2025-11-27T00:44:20,660 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml' 2025-11-27T00:44:20,661 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml' 2025-11-27T00:44:20,662 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml' 2025-11-27T00:44:20,663 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml' 2025-11-27T00:44:20,664 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml' 2025-11-27T00:44:20,666 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml' 2025-11-27T00:44:20,667 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml' 2025-11-27T00:44:20,668 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml' 2025-11-27T00:44:20,669 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml' 2025-11-27T00:44:20,671 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml' 2025-11-27T00:44:20,672 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml' 2025-11-27T00:44:20,673 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml' 2025-11-27T00:44:20,674 adding 'lm_eval/tasks/mmlu_prox/uk/utils.py' 2025-11-27T00:44:20,677 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml' 2025-11-27T00:44:20,678 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml' 2025-11-27T00:44:20,679 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml' 2025-11-27T00:44:20,680 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml' 2025-11-27T00:44:20,681 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml' 2025-11-27T00:44:20,683 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml' 2025-11-27T00:44:20,684 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml' 2025-11-27T00:44:20,685 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml' 2025-11-27T00:44:20,686 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml' 2025-11-27T00:44:20,688 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml' 2025-11-27T00:44:20,689 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml' 2025-11-27T00:44:20,690 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml' 2025-11-27T00:44:20,691 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml' 2025-11-27T00:44:20,693 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml' 2025-11-27T00:44:20,694 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml' 2025-11-27T00:44:20,695 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml' 2025-11-27T00:44:20,696 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml' 2025-11-27T00:44:20,698 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml' 2025-11-27T00:44:20,699 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml' 2025-11-27T00:44:20,700 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml' 2025-11-27T00:44:20,701 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml' 2025-11-27T00:44:20,703 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml' 2025-11-27T00:44:20,704 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml' 2025-11-27T00:44:20,705 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml' 2025-11-27T00:44:20,706 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml' 2025-11-27T00:44:20,707 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml' 2025-11-27T00:44:20,709 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml' 2025-11-27T00:44:20,710 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml' 2025-11-27T00:44:20,711 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml' 2025-11-27T00:44:20,712 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml' 2025-11-27T00:44:20,713 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml' 2025-11-27T00:44:20,715 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml' 2025-11-27T00:44:20,716 adding 'lm_eval/tasks/mmlu_prox/ur/utils.py' 2025-11-27T00:44:20,718 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml' 2025-11-27T00:44:20,719 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml' 2025-11-27T00:44:20,720 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml' 2025-11-27T00:44:20,721 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml' 2025-11-27T00:44:20,723 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml' 2025-11-27T00:44:20,724 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml' 2025-11-27T00:44:20,725 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml' 2025-11-27T00:44:20,726 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml' 2025-11-27T00:44:20,727 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml' 2025-11-27T00:44:20,729 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml' 2025-11-27T00:44:20,730 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml' 2025-11-27T00:44:20,731 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml' 2025-11-27T00:44:20,732 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml' 2025-11-27T00:44:20,733 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml' 2025-11-27T00:44:20,735 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml' 2025-11-27T00:44:20,736 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml' 2025-11-27T00:44:20,737 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml' 2025-11-27T00:44:20,738 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml' 2025-11-27T00:44:20,739 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml' 2025-11-27T00:44:20,741 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml' 2025-11-27T00:44:20,742 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml' 2025-11-27T00:44:20,743 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml' 2025-11-27T00:44:20,744 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml' 2025-11-27T00:44:20,745 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml' 2025-11-27T00:44:20,747 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml' 2025-11-27T00:44:20,748 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml' 2025-11-27T00:44:20,749 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml' 2025-11-27T00:44:20,750 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml' 2025-11-27T00:44:20,752 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml' 2025-11-27T00:44:20,753 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml' 2025-11-27T00:44:20,754 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml' 2025-11-27T00:44:20,755 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml' 2025-11-27T00:44:20,757 adding 'lm_eval/tasks/mmlu_prox/vi/utils.py' 2025-11-27T00:44:20,759 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml' 2025-11-27T00:44:20,761 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml' 2025-11-27T00:44:20,762 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml' 2025-11-27T00:44:20,764 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml' 2025-11-27T00:44:20,765 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml' 2025-11-27T00:44:20,767 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml' 2025-11-27T00:44:20,769 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml' 2025-11-27T00:44:20,770 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml' 2025-11-27T00:44:20,771 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml' 2025-11-27T00:44:20,772 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml' 2025-11-27T00:44:20,773 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml' 2025-11-27T00:44:20,775 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml' 2025-11-27T00:44:20,776 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml' 2025-11-27T00:44:20,777 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml' 2025-11-27T00:44:20,778 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml' 2025-11-27T00:44:20,779 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml' 2025-11-27T00:44:20,780 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml' 2025-11-27T00:44:20,781 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml' 2025-11-27T00:44:20,783 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml' 2025-11-27T00:44:20,784 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml' 2025-11-27T00:44:20,785 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml' 2025-11-27T00:44:20,786 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml' 2025-11-27T00:44:20,787 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml' 2025-11-27T00:44:20,788 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml' 2025-11-27T00:44:20,790 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml' 2025-11-27T00:44:20,791 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml' 2025-11-27T00:44:20,792 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml' 2025-11-27T00:44:20,793 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml' 2025-11-27T00:44:20,794 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml' 2025-11-27T00:44:20,795 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml' 2025-11-27T00:44:20,796 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml' 2025-11-27T00:44:20,798 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml' 2025-11-27T00:44:20,799 adding 'lm_eval/tasks/mmlu_prox/wo/utils.py' 2025-11-27T00:44:20,802 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml' 2025-11-27T00:44:20,803 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml' 2025-11-27T00:44:20,805 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml' 2025-11-27T00:44:20,806 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml' 2025-11-27T00:44:20,808 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml' 2025-11-27T00:44:20,809 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml' 2025-11-27T00:44:20,811 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml' 2025-11-27T00:44:20,812 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml' 2025-11-27T00:44:20,813 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml' 2025-11-27T00:44:20,814 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml' 2025-11-27T00:44:20,815 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml' 2025-11-27T00:44:20,817 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml' 2025-11-27T00:44:20,818 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml' 2025-11-27T00:44:20,819 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml' 2025-11-27T00:44:20,820 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml' 2025-11-27T00:44:20,822 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml' 2025-11-27T00:44:20,823 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml' 2025-11-27T00:44:20,824 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml' 2025-11-27T00:44:20,825 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml' 2025-11-27T00:44:20,827 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml' 2025-11-27T00:44:20,828 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml' 2025-11-27T00:44:20,829 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml' 2025-11-27T00:44:20,830 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml' 2025-11-27T00:44:20,831 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml' 2025-11-27T00:44:20,832 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml' 2025-11-27T00:44:20,833 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml' 2025-11-27T00:44:20,835 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml' 2025-11-27T00:44:20,836 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml' 2025-11-27T00:44:20,837 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml' 2025-11-27T00:44:20,838 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml' 2025-11-27T00:44:20,839 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml' 2025-11-27T00:44:20,841 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml' 2025-11-27T00:44:20,842 adding 'lm_eval/tasks/mmlu_prox/yo/utils.py' 2025-11-27T00:44:20,844 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml' 2025-11-27T00:44:20,845 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml' 2025-11-27T00:44:20,846 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml' 2025-11-27T00:44:20,848 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml' 2025-11-27T00:44:20,849 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml' 2025-11-27T00:44:20,850 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml' 2025-11-27T00:44:20,851 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml' 2025-11-27T00:44:20,852 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml' 2025-11-27T00:44:20,854 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml' 2025-11-27T00:44:20,855 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml' 2025-11-27T00:44:20,856 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml' 2025-11-27T00:44:20,857 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml' 2025-11-27T00:44:20,859 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml' 2025-11-27T00:44:20,860 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml' 2025-11-27T00:44:20,861 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml' 2025-11-27T00:44:20,862 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml' 2025-11-27T00:44:20,864 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml' 2025-11-27T00:44:20,865 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml' 2025-11-27T00:44:20,866 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml' 2025-11-27T00:44:20,867 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml' 2025-11-27T00:44:20,868 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml' 2025-11-27T00:44:20,870 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml' 2025-11-27T00:44:20,871 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml' 2025-11-27T00:44:20,872 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml' 2025-11-27T00:44:20,873 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml' 2025-11-27T00:44:20,875 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml' 2025-11-27T00:44:20,876 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml' 2025-11-27T00:44:20,877 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml' 2025-11-27T00:44:20,878 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml' 2025-11-27T00:44:20,879 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml' 2025-11-27T00:44:20,881 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml' 2025-11-27T00:44:20,882 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml' 2025-11-27T00:44:20,883 adding 'lm_eval/tasks/mmlu_prox/zh/utils.py' 2025-11-27T00:44:20,885 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml' 2025-11-27T00:44:20,886 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml' 2025-11-27T00:44:20,888 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml' 2025-11-27T00:44:20,889 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml' 2025-11-27T00:44:20,890 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml' 2025-11-27T00:44:20,891 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml' 2025-11-27T00:44:20,892 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml' 2025-11-27T00:44:20,893 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml' 2025-11-27T00:44:20,894 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml' 2025-11-27T00:44:20,896 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml' 2025-11-27T00:44:20,897 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml' 2025-11-27T00:44:20,898 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml' 2025-11-27T00:44:20,899 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml' 2025-11-27T00:44:20,900 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml' 2025-11-27T00:44:20,901 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml' 2025-11-27T00:44:20,902 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml' 2025-11-27T00:44:20,903 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml' 2025-11-27T00:44:20,905 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml' 2025-11-27T00:44:20,906 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml' 2025-11-27T00:44:20,907 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml' 2025-11-27T00:44:20,908 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml' 2025-11-27T00:44:20,909 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml' 2025-11-27T00:44:20,911 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml' 2025-11-27T00:44:20,912 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml' 2025-11-27T00:44:20,913 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml' 2025-11-27T00:44:20,914 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml' 2025-11-27T00:44:20,915 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml' 2025-11-27T00:44:20,917 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml' 2025-11-27T00:44:20,918 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml' 2025-11-27T00:44:20,919 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml' 2025-11-27T00:44:20,920 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml' 2025-11-27T00:44:20,921 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml' 2025-11-27T00:44:20,923 adding 'lm_eval/tasks/mmlu_prox/zu/utils.py' 2025-11-27T00:44:20,925 adding 'lm_eval/tasks/mmlusr/README.md' 2025-11-27T00:44:20,926 adding 'lm_eval/tasks/mmlusr/config.py' 2025-11-27T00:44:20,929 adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml' 2025-11-27T00:44:20,930 adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml' 2025-11-27T00:44:20,932 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml' 2025-11-27T00:44:20,933 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml' 2025-11-27T00:44:20,934 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml' 2025-11-27T00:44:20,935 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml' 2025-11-27T00:44:20,936 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml' 2025-11-27T00:44:20,938 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml' 2025-11-27T00:44:20,939 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml' 2025-11-27T00:44:20,940 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml' 2025-11-27T00:44:20,941 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml' 2025-11-27T00:44:20,942 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml' 2025-11-27T00:44:20,943 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml' 2025-11-27T00:44:20,945 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml' 2025-11-27T00:44:20,946 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml' 2025-11-27T00:44:20,947 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml' 2025-11-27T00:44:20,948 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml' 2025-11-27T00:44:20,949 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml' 2025-11-27T00:44:20,950 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml' 2025-11-27T00:44:20,951 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml' 2025-11-27T00:44:20,952 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml' 2025-11-27T00:44:20,953 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml' 2025-11-27T00:44:20,954 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml' 2025-11-27T00:44:20,956 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml' 2025-11-27T00:44:20,957 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml' 2025-11-27T00:44:20,958 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml' 2025-11-27T00:44:20,959 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml' 2025-11-27T00:44:20,960 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml' 2025-11-27T00:44:20,961 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml' 2025-11-27T00:44:20,962 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml' 2025-11-27T00:44:20,964 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml' 2025-11-27T00:44:20,965 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml' 2025-11-27T00:44:20,966 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml' 2025-11-27T00:44:20,967 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml' 2025-11-27T00:44:20,968 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml' 2025-11-27T00:44:20,970 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml' 2025-11-27T00:44:20,971 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml' 2025-11-27T00:44:20,972 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml' 2025-11-27T00:44:20,973 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml' 2025-11-27T00:44:20,974 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml' 2025-11-27T00:44:20,975 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml' 2025-11-27T00:44:20,976 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml' 2025-11-27T00:44:20,978 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml' 2025-11-27T00:44:20,979 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml' 2025-11-27T00:44:20,980 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml' 2025-11-27T00:44:20,981 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml' 2025-11-27T00:44:20,982 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml' 2025-11-27T00:44:20,983 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml' 2025-11-27T00:44:20,985 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml' 2025-11-27T00:44:20,986 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml' 2025-11-27T00:44:20,987 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml' 2025-11-27T00:44:20,988 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml' 2025-11-27T00:44:20,989 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml' 2025-11-27T00:44:20,990 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml' 2025-11-27T00:44:20,991 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml' 2025-11-27T00:44:20,992 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml' 2025-11-27T00:44:20,993 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml' 2025-11-27T00:44:20,994 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml' 2025-11-27T00:44:20,995 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml' 2025-11-27T00:44:20,996 adding 'lm_eval/tasks/mmlusr/answer_only/utils.py' 2025-11-27T00:44:20,999 adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml' 2025-11-27T00:44:21,000 adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml' 2025-11-27T00:44:21,001 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml' 2025-11-27T00:44:21,002 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml' 2025-11-27T00:44:21,004 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml' 2025-11-27T00:44:21,005 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml' 2025-11-27T00:44:21,006 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml' 2025-11-27T00:44:21,007 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml' 2025-11-27T00:44:21,008 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml' 2025-11-27T00:44:21,009 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml' 2025-11-27T00:44:21,011 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml' 2025-11-27T00:44:21,012 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml' 2025-11-27T00:44:21,013 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml' 2025-11-27T00:44:21,014 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml' 2025-11-27T00:44:21,015 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml' 2025-11-27T00:44:21,016 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml' 2025-11-27T00:44:21,018 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml' 2025-11-27T00:44:21,019 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml' 2025-11-27T00:44:21,020 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml' 2025-11-27T00:44:21,021 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml' 2025-11-27T00:44:21,022 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml' 2025-11-27T00:44:21,024 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml' 2025-11-27T00:44:21,025 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml' 2025-11-27T00:44:21,026 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml' 2025-11-27T00:44:21,027 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml' 2025-11-27T00:44:21,028 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml' 2025-11-27T00:44:21,029 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml' 2025-11-27T00:44:21,030 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml' 2025-11-27T00:44:21,032 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml' 2025-11-27T00:44:21,033 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml' 2025-11-27T00:44:21,034 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml' 2025-11-27T00:44:21,035 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml' 2025-11-27T00:44:21,036 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml' 2025-11-27T00:44:21,037 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml' 2025-11-27T00:44:21,039 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml' 2025-11-27T00:44:21,040 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml' 2025-11-27T00:44:21,041 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml' 2025-11-27T00:44:21,042 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml' 2025-11-27T00:44:21,043 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml' 2025-11-27T00:44:21,044 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml' 2025-11-27T00:44:21,046 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml' 2025-11-27T00:44:21,047 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml' 2025-11-27T00:44:21,048 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml' 2025-11-27T00:44:21,049 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml' 2025-11-27T00:44:21,051 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml' 2025-11-27T00:44:21,052 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml' 2025-11-27T00:44:21,053 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml' 2025-11-27T00:44:21,054 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml' 2025-11-27T00:44:21,055 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml' 2025-11-27T00:44:21,056 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml' 2025-11-27T00:44:21,058 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml' 2025-11-27T00:44:21,059 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml' 2025-11-27T00:44:21,060 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml' 2025-11-27T00:44:21,061 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml' 2025-11-27T00:44:21,062 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml' 2025-11-27T00:44:21,064 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml' 2025-11-27T00:44:21,065 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml' 2025-11-27T00:44:21,066 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml' 2025-11-27T00:44:21,067 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml' 2025-11-27T00:44:21,069 adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py' 2025-11-27T00:44:21,071 adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml' 2025-11-27T00:44:21,072 adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml' 2025-11-27T00:44:21,074 adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml' 2025-11-27T00:44:21,075 adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml' 2025-11-27T00:44:21,076 adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml' 2025-11-27T00:44:21,077 adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml' 2025-11-27T00:44:21,078 adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml' 2025-11-27T00:44:21,079 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml' 2025-11-27T00:44:21,080 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml' 2025-11-27T00:44:21,081 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml' 2025-11-27T00:44:21,083 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml' 2025-11-27T00:44:21,084 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml' 2025-11-27T00:44:21,085 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml' 2025-11-27T00:44:21,086 adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml' 2025-11-27T00:44:21,087 adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml' 2025-11-27T00:44:21,088 adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml' 2025-11-27T00:44:21,090 adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml' 2025-11-27T00:44:21,091 adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml' 2025-11-27T00:44:21,092 adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml' 2025-11-27T00:44:21,093 adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml' 2025-11-27T00:44:21,094 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml' 2025-11-27T00:44:21,096 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml' 2025-11-27T00:44:21,097 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml' 2025-11-27T00:44:21,098 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml' 2025-11-27T00:44:21,099 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml' 2025-11-27T00:44:21,100 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml' 2025-11-27T00:44:21,102 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml' 2025-11-27T00:44:21,103 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml' 2025-11-27T00:44:21,104 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml' 2025-11-27T00:44:21,105 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml' 2025-11-27T00:44:21,106 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml' 2025-11-27T00:44:21,108 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml' 2025-11-27T00:44:21,109 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml' 2025-11-27T00:44:21,110 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml' 2025-11-27T00:44:21,111 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml' 2025-11-27T00:44:21,113 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml' 2025-11-27T00:44:21,114 adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml' 2025-11-27T00:44:21,115 adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml' 2025-11-27T00:44:21,116 adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml' 2025-11-27T00:44:21,117 adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml' 2025-11-27T00:44:21,118 adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml' 2025-11-27T00:44:21,119 adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml' 2025-11-27T00:44:21,121 adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml' 2025-11-27T00:44:21,122 adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml' 2025-11-27T00:44:21,123 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml' 2025-11-27T00:44:21,124 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml' 2025-11-27T00:44:21,125 adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml' 2025-11-27T00:44:21,126 adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml' 2025-11-27T00:44:21,128 adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml' 2025-11-27T00:44:21,129 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml' 2025-11-27T00:44:21,130 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml' 2025-11-27T00:44:21,131 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml' 2025-11-27T00:44:21,132 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml' 2025-11-27T00:44:21,134 adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml' 2025-11-27T00:44:21,135 adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml' 2025-11-27T00:44:21,136 adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml' 2025-11-27T00:44:21,137 adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml' 2025-11-27T00:44:21,138 adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml' 2025-11-27T00:44:21,139 adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml' 2025-11-27T00:44:21,140 adding 'lm_eval/tasks/mmlusr/question_only/utils.py' 2025-11-27T00:44:21,143 adding 'lm_eval/tasks/mmmu/README.md' 2025-11-27T00:44:21,144 adding 'lm_eval/tasks/mmmu/_art_and_design.yaml' 2025-11-27T00:44:21,146 adding 'lm_eval/tasks/mmmu/_business.yaml' 2025-11-27T00:44:21,147 adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml' 2025-11-27T00:44:21,148 adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml' 2025-11-27T00:44:21,149 adding 'lm_eval/tasks/mmmu/_mmmu.yaml' 2025-11-27T00:44:21,150 adding 'lm_eval/tasks/mmmu/_science.yaml' 2025-11-27T00:44:21,152 adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml' 2025-11-27T00:44:21,153 adding 'lm_eval/tasks/mmmu/_template_yaml' 2025-11-27T00:44:21,154 adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml' 2025-11-27T00:44:21,155 adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml' 2025-11-27T00:44:21,156 adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml' 2025-11-27T00:44:21,157 adding 'lm_eval/tasks/mmmu/mmmu_art.yaml' 2025-11-27T00:44:21,159 adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml' 2025-11-27T00:44:21,160 adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml' 2025-11-27T00:44:21,161 adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml' 2025-11-27T00:44:21,162 adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml' 2025-11-27T00:44:21,163 adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml' 2025-11-27T00:44:21,164 adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml' 2025-11-27T00:44:21,166 adding 'lm_eval/tasks/mmmu/mmmu_design.yaml' 2025-11-27T00:44:21,167 adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml' 2025-11-27T00:44:21,170 adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml' 2025-11-27T00:44:21,171 adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml' 2025-11-27T00:44:21,173 adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml' 2025-11-27T00:44:21,174 adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml' 2025-11-27T00:44:21,175 adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml' 2025-11-27T00:44:21,177 adding 'lm_eval/tasks/mmmu/mmmu_history.yaml' 2025-11-27T00:44:21,178 adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml' 2025-11-27T00:44:21,180 adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml' 2025-11-27T00:44:21,181 adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml' 2025-11-27T00:44:21,182 adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml' 2025-11-27T00:44:21,184 adding 'lm_eval/tasks/mmmu/mmmu_math.yaml' 2025-11-27T00:44:21,185 adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml' 2025-11-27T00:44:21,187 adding 'lm_eval/tasks/mmmu/mmmu_music.yaml' 2025-11-27T00:44:21,188 adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml' 2025-11-27T00:44:21,190 adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml' 2025-11-27T00:44:21,191 adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml' 2025-11-27T00:44:21,193 adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml' 2025-11-27T00:44:21,194 adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml' 2025-11-27T00:44:21,197 adding 'lm_eval/tasks/mmmu/utils.py' 2025-11-27T00:44:21,201 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py' 2025-11-27T00:44:21,202 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml' 2025-11-27T00:44:21,204 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml' 2025-11-27T00:44:21,205 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml' 2025-11-27T00:44:21,207 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml' 2025-11-27T00:44:21,208 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml' 2025-11-27T00:44:21,210 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml' 2025-11-27T00:44:21,211 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml' 2025-11-27T00:44:21,213 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml' 2025-11-27T00:44:21,214 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml' 2025-11-27T00:44:21,216 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml' 2025-11-27T00:44:21,217 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml' 2025-11-27T00:44:21,218 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml' 2025-11-27T00:44:21,220 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml' 2025-11-27T00:44:21,221 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml' 2025-11-27T00:44:21,223 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml' 2025-11-27T00:44:21,225 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml' 2025-11-27T00:44:21,226 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml' 2025-11-27T00:44:21,228 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml' 2025-11-27T00:44:21,229 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml' 2025-11-27T00:44:21,231 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml' 2025-11-27T00:44:21,233 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml' 2025-11-27T00:44:21,235 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml' 2025-11-27T00:44:21,236 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml' 2025-11-27T00:44:21,238 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml' 2025-11-27T00:44:21,240 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml' 2025-11-27T00:44:21,241 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml' 2025-11-27T00:44:21,243 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml' 2025-11-27T00:44:21,244 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml' 2025-11-27T00:44:21,245 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml' 2025-11-27T00:44:21,247 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml' 2025-11-27T00:44:21,248 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml' 2025-11-27T00:44:21,250 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml' 2025-11-27T00:44:21,251 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml' 2025-11-27T00:44:21,253 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml' 2025-11-27T00:44:21,254 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml' 2025-11-27T00:44:21,256 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml' 2025-11-27T00:44:21,257 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml' 2025-11-27T00:44:21,259 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml' 2025-11-27T00:44:21,260 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml' 2025-11-27T00:44:21,262 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml' 2025-11-27T00:44:21,263 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml' 2025-11-27T00:44:21,265 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml' 2025-11-27T00:44:21,266 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml' 2025-11-27T00:44:21,267 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml' 2025-11-27T00:44:21,268 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml' 2025-11-27T00:44:21,270 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml' 2025-11-27T00:44:21,271 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml' 2025-11-27T00:44:21,272 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml' 2025-11-27T00:44:21,273 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml' 2025-11-27T00:44:21,274 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml' 2025-11-27T00:44:21,279 adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py' 2025-11-27T00:44:21,280 adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml' 2025-11-27T00:44:21,281 adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml' 2025-11-27T00:44:21,282 adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml' 2025-11-27T00:44:21,284 adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml' 2025-11-27T00:44:21,285 adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml' 2025-11-27T00:44:21,286 adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml' 2025-11-27T00:44:21,287 adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml' 2025-11-27T00:44:21,289 adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml' 2025-11-27T00:44:21,290 adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml' 2025-11-27T00:44:21,291 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml' 2025-11-27T00:44:21,292 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml' 2025-11-27T00:44:21,293 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml' 2025-11-27T00:44:21,294 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml' 2025-11-27T00:44:21,295 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml' 2025-11-27T00:44:21,296 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml' 2025-11-27T00:44:21,298 adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml' 2025-11-27T00:44:21,299 adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml' 2025-11-27T00:44:21,300 adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml' 2025-11-27T00:44:21,301 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml' 2025-11-27T00:44:21,303 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml' 2025-11-27T00:44:21,304 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml' 2025-11-27T00:44:21,305 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml' 2025-11-27T00:44:21,306 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml' 2025-11-27T00:44:21,307 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml' 2025-11-27T00:44:21,308 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml' 2025-11-27T00:44:21,310 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml' 2025-11-27T00:44:21,311 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml' 2025-11-27T00:44:21,312 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml' 2025-11-27T00:44:21,313 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml' 2025-11-27T00:44:21,314 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml' 2025-11-27T00:44:21,316 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml' 2025-11-27T00:44:21,317 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml' 2025-11-27T00:44:21,318 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml' 2025-11-27T00:44:21,319 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml' 2025-11-27T00:44:21,320 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml' 2025-11-27T00:44:21,322 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml' 2025-11-27T00:44:21,323 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml' 2025-11-27T00:44:21,324 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml' 2025-11-27T00:44:21,325 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml' 2025-11-27T00:44:21,326 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml' 2025-11-27T00:44:21,327 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml' 2025-11-27T00:44:21,329 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml' 2025-11-27T00:44:21,330 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml' 2025-11-27T00:44:21,331 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml' 2025-11-27T00:44:21,332 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml' 2025-11-27T00:44:21,333 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml' 2025-11-27T00:44:21,334 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml' 2025-11-27T00:44:21,335 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml' 2025-11-27T00:44:21,336 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml' 2025-11-27T00:44:21,337 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml' 2025-11-27T00:44:21,338 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml' 2025-11-27T00:44:21,340 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml' 2025-11-27T00:44:21,341 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml' 2025-11-27T00:44:21,342 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml' 2025-11-27T00:44:21,343 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml' 2025-11-27T00:44:21,344 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml' 2025-11-27T00:44:21,345 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml' 2025-11-27T00:44:21,346 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml' 2025-11-27T00:44:21,347 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml' 2025-11-27T00:44:21,348 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml' 2025-11-27T00:44:21,350 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml' 2025-11-27T00:44:21,351 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml' 2025-11-27T00:44:21,352 adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml' 2025-11-27T00:44:21,353 adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml' 2025-11-27T00:44:21,354 adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml' 2025-11-27T00:44:21,355 adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml' 2025-11-27T00:44:21,357 adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml' 2025-11-27T00:44:21,358 adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml' 2025-11-27T00:44:21,359 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml' 2025-11-27T00:44:21,360 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml' 2025-11-27T00:44:21,361 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml' 2025-11-27T00:44:21,363 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml' 2025-11-27T00:44:21,364 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml' 2025-11-27T00:44:21,365 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml' 2025-11-27T00:44:21,366 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml' 2025-11-27T00:44:21,367 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml' 2025-11-27T00:44:21,368 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml' 2025-11-27T00:44:21,369 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml' 2025-11-27T00:44:21,371 adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml' 2025-11-27T00:44:21,372 adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml' 2025-11-27T00:44:21,372 adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml' 2025-11-27T00:44:21,374 adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml' 2025-11-27T00:44:21,375 adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml' 2025-11-27T00:44:21,376 adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml' 2025-11-27T00:44:21,377 adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml' 2025-11-27T00:44:21,378 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml' 2025-11-27T00:44:21,379 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml' 2025-11-27T00:44:21,380 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml' 2025-11-27T00:44:21,381 adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml' 2025-11-27T00:44:21,382 adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml' 2025-11-27T00:44:21,383 adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml' 2025-11-27T00:44:21,384 adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml' 2025-11-27T00:44:21,385 adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml' 2025-11-27T00:44:21,387 adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml' 2025-11-27T00:44:21,388 adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml' 2025-11-27T00:44:21,389 adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml' 2025-11-27T00:44:21,390 adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml' 2025-11-27T00:44:21,391 adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml' 2025-11-27T00:44:21,392 adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml' 2025-11-27T00:44:21,393 adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml' 2025-11-27T00:44:21,395 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml' 2025-11-27T00:44:21,396 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml' 2025-11-27T00:44:21,397 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml' 2025-11-27T00:44:21,398 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml' 2025-11-27T00:44:21,399 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml' 2025-11-27T00:44:21,401 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml' 2025-11-27T00:44:21,402 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml' 2025-11-27T00:44:21,403 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml' 2025-11-27T00:44:21,404 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml' 2025-11-27T00:44:21,405 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml' 2025-11-27T00:44:21,406 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml' 2025-11-27T00:44:21,408 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml' 2025-11-27T00:44:21,409 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml' 2025-11-27T00:44:21,410 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml' 2025-11-27T00:44:21,411 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml' 2025-11-27T00:44:21,412 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml' 2025-11-27T00:44:21,413 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml' 2025-11-27T00:44:21,414 adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml' 2025-11-27T00:44:21,415 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml' 2025-11-27T00:44:21,416 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml' 2025-11-27T00:44:21,417 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml' 2025-11-27T00:44:21,419 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml' 2025-11-27T00:44:21,420 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml' 2025-11-27T00:44:21,421 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml' 2025-11-27T00:44:21,422 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml' 2025-11-27T00:44:21,423 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml' 2025-11-27T00:44:21,424 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml' 2025-11-27T00:44:21,425 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml' 2025-11-27T00:44:21,426 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml' 2025-11-27T00:44:21,427 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml' 2025-11-27T00:44:21,428 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml' 2025-11-27T00:44:21,430 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml' 2025-11-27T00:44:21,431 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml' 2025-11-27T00:44:21,432 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml' 2025-11-27T00:44:21,433 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml' 2025-11-27T00:44:21,435 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml' 2025-11-27T00:44:21,436 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml' 2025-11-27T00:44:21,438 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml' 2025-11-27T00:44:21,439 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml' 2025-11-27T00:44:21,440 adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated' 2025-11-27T00:44:21,443 adding 'lm_eval/tasks/moral_stories/README.md' 2025-11-27T00:44:21,444 adding 'lm_eval/tasks/moral_stories/moral_stories.yaml' 2025-11-27T00:44:21,445 adding 'lm_eval/tasks/moral_stories/utils.py' 2025-11-27T00:44:21,447 adding 'lm_eval/tasks/mts_dialog/README.md' 2025-11-27T00:44:21,448 adding 'lm_eval/tasks/mts_dialog/mts_dialog.yaml' 2025-11-27T00:44:21,449 adding 'lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml' 2025-11-27T00:44:21,451 adding 'lm_eval/tasks/mts_dialog/utils.py' 2025-11-27T00:44:21,452 adding 'lm_eval/tasks/mts_dialog/utils_perplexity.py' 2025-11-27T00:44:21,456 adding 'lm_eval/tasks/multiblimp/README.md' 2025-11-27T00:44:21,458 adding 'lm_eval/tasks/multiblimp/_template_yaml' 2025-11-27T00:44:21,459 adding 'lm_eval/tasks/multiblimp/multiblimp_abk.yaml' 2025-11-27T00:44:21,460 adding 'lm_eval/tasks/multiblimp/multiblimp_aln.yaml' 2025-11-27T00:44:21,461 adding 'lm_eval/tasks/multiblimp/multiblimp_amh.yaml' 2025-11-27T00:44:21,462 adding 'lm_eval/tasks/multiblimp/multiblimp_apu.yaml' 2025-11-27T00:44:21,463 adding 'lm_eval/tasks/multiblimp/multiblimp_aqz.yaml' 2025-11-27T00:44:21,464 adding 'lm_eval/tasks/multiblimp/multiblimp_arb.yaml' 2025-11-27T00:44:21,466 adding 'lm_eval/tasks/multiblimp/multiblimp_azz.yaml' 2025-11-27T00:44:21,467 adding 'lm_eval/tasks/multiblimp/multiblimp_bel.yaml' 2025-11-27T00:44:21,468 adding 'lm_eval/tasks/multiblimp/multiblimp_ben.yaml' 2025-11-27T00:44:21,469 adding 'lm_eval/tasks/multiblimp/multiblimp_bho.yaml' 2025-11-27T00:44:21,470 adding 'lm_eval/tasks/multiblimp/multiblimp_bor.yaml' 2025-11-27T00:44:21,471 adding 'lm_eval/tasks/multiblimp/multiblimp_bre.yaml' 2025-11-27T00:44:21,472 adding 'lm_eval/tasks/multiblimp/multiblimp_bua.yaml' 2025-11-27T00:44:21,473 adding 'lm_eval/tasks/multiblimp/multiblimp_bul.yaml' 2025-11-27T00:44:21,474 adding 'lm_eval/tasks/multiblimp/multiblimp_cat.yaml' 2025-11-27T00:44:21,475 adding 'lm_eval/tasks/multiblimp/multiblimp_ces.yaml' 2025-11-27T00:44:21,476 adding 'lm_eval/tasks/multiblimp/multiblimp_chu.yaml' 2025-11-27T00:44:21,477 adding 'lm_eval/tasks/multiblimp/multiblimp_cym.yaml' 2025-11-27T00:44:21,478 adding 'lm_eval/tasks/multiblimp/multiblimp_dan.yaml' 2025-11-27T00:44:21,480 adding 'lm_eval/tasks/multiblimp/multiblimp_deu.yaml' 2025-11-27T00:44:21,481 adding 'lm_eval/tasks/multiblimp/multiblimp_egy.yaml' 2025-11-27T00:44:21,482 adding 'lm_eval/tasks/multiblimp/multiblimp_ell.yaml' 2025-11-27T00:44:21,483 adding 'lm_eval/tasks/multiblimp/multiblimp_eng.yaml' 2025-11-27T00:44:21,484 adding 'lm_eval/tasks/multiblimp/multiblimp_est.yaml' 2025-11-27T00:44:21,485 adding 'lm_eval/tasks/multiblimp/multiblimp_eus.yaml' 2025-11-27T00:44:21,486 adding 'lm_eval/tasks/multiblimp/multiblimp_fao.yaml' 2025-11-27T00:44:21,487 adding 'lm_eval/tasks/multiblimp/multiblimp_fas.yaml' 2025-11-27T00:44:21,488 adding 'lm_eval/tasks/multiblimp/multiblimp_fin.yaml' 2025-11-27T00:44:21,489 adding 'lm_eval/tasks/multiblimp/multiblimp_fra.yaml' 2025-11-27T00:44:21,490 adding 'lm_eval/tasks/multiblimp/multiblimp_frm.yaml' 2025-11-27T00:44:21,491 adding 'lm_eval/tasks/multiblimp/multiblimp_fro.yaml' 2025-11-27T00:44:21,493 adding 'lm_eval/tasks/multiblimp/multiblimp_gla.yaml' 2025-11-27T00:44:21,494 adding 'lm_eval/tasks/multiblimp/multiblimp_gle.yaml' 2025-11-27T00:44:21,495 adding 'lm_eval/tasks/multiblimp/multiblimp_glg.yaml' 2025-11-27T00:44:21,496 adding 'lm_eval/tasks/multiblimp/multiblimp_got.yaml' 2025-11-27T00:44:21,497 adding 'lm_eval/tasks/multiblimp/multiblimp_grc.yaml' 2025-11-27T00:44:21,498 adding 'lm_eval/tasks/multiblimp/multiblimp_guj.yaml' 2025-11-27T00:44:21,499 adding 'lm_eval/tasks/multiblimp/multiblimp_hbo.yaml' 2025-11-27T00:44:21,501 adding 'lm_eval/tasks/multiblimp/multiblimp_hbs.yaml' 2025-11-27T00:44:21,502 adding 'lm_eval/tasks/multiblimp/multiblimp_heb.yaml' 2025-11-27T00:44:21,503 adding 'lm_eval/tasks/multiblimp/multiblimp_hin.yaml' 2025-11-27T00:44:21,504 adding 'lm_eval/tasks/multiblimp/multiblimp_hit.yaml' 2025-11-27T00:44:21,505 adding 'lm_eval/tasks/multiblimp/multiblimp_hsb.yaml' 2025-11-27T00:44:21,506 adding 'lm_eval/tasks/multiblimp/multiblimp_hun.yaml' 2025-11-27T00:44:21,507 adding 'lm_eval/tasks/multiblimp/multiblimp_hye.yaml' 2025-11-27T00:44:21,508 adding 'lm_eval/tasks/multiblimp/multiblimp_hyw.yaml' 2025-11-27T00:44:21,510 adding 'lm_eval/tasks/multiblimp/multiblimp_isl.yaml' 2025-11-27T00:44:21,511 adding 'lm_eval/tasks/multiblimp/multiblimp_ita.yaml' 2025-11-27T00:44:21,512 adding 'lm_eval/tasks/multiblimp/multiblimp_kat.yaml' 2025-11-27T00:44:21,513 adding 'lm_eval/tasks/multiblimp/multiblimp_kaz.yaml' 2025-11-27T00:44:21,514 adding 'lm_eval/tasks/multiblimp/multiblimp_kir.yaml' 2025-11-27T00:44:21,515 adding 'lm_eval/tasks/multiblimp/multiblimp_kmr.yaml' 2025-11-27T00:44:21,516 adding 'lm_eval/tasks/multiblimp/multiblimp_koi.yaml' 2025-11-27T00:44:21,517 adding 'lm_eval/tasks/multiblimp/multiblimp_kpv.yaml' 2025-11-27T00:44:21,518 adding 'lm_eval/tasks/multiblimp/multiblimp_krl.yaml' 2025-11-27T00:44:21,519 adding 'lm_eval/tasks/multiblimp/multiblimp_kxh.yaml' 2025-11-27T00:44:21,521 adding 'lm_eval/tasks/multiblimp/multiblimp_lat.yaml' 2025-11-27T00:44:21,522 adding 'lm_eval/tasks/multiblimp/multiblimp_lav.yaml' 2025-11-27T00:44:21,523 adding 'lm_eval/tasks/multiblimp/multiblimp_lij.yaml' 2025-11-27T00:44:21,524 adding 'lm_eval/tasks/multiblimp/multiblimp_lit.yaml' 2025-11-27T00:44:21,525 adding 'lm_eval/tasks/multiblimp/multiblimp_mar.yaml' 2025-11-27T00:44:21,526 adding 'lm_eval/tasks/multiblimp/multiblimp_mdf.yaml' 2025-11-27T00:44:21,527 adding 'lm_eval/tasks/multiblimp/multiblimp_mkd.yaml' 2025-11-27T00:44:21,528 adding 'lm_eval/tasks/multiblimp/multiblimp_myv.yaml' 2025-11-27T00:44:21,529 adding 'lm_eval/tasks/multiblimp/multiblimp_nds.yaml' 2025-11-27T00:44:21,530 adding 'lm_eval/tasks/multiblimp/multiblimp_nhi.yaml' 2025-11-27T00:44:21,531 adding 'lm_eval/tasks/multiblimp/multiblimp_nld.yaml' 2025-11-27T00:44:21,533 adding 'lm_eval/tasks/multiblimp/multiblimp_olo.yaml' 2025-11-27T00:44:21,534 adding 'lm_eval/tasks/multiblimp/multiblimp_orv.yaml' 2025-11-27T00:44:21,535 adding 'lm_eval/tasks/multiblimp/multiblimp_ota.yaml' 2025-11-27T00:44:21,536 adding 'lm_eval/tasks/multiblimp/multiblimp_pcm.yaml' 2025-11-27T00:44:21,537 adding 'lm_eval/tasks/multiblimp/multiblimp_pol.yaml' 2025-11-27T00:44:21,538 adding 'lm_eval/tasks/multiblimp/multiblimp_por.yaml' 2025-11-27T00:44:21,539 adding 'lm_eval/tasks/multiblimp/multiblimp_quc.yaml' 2025-11-27T00:44:21,540 adding 'lm_eval/tasks/multiblimp/multiblimp_ron.yaml' 2025-11-27T00:44:21,542 adding 'lm_eval/tasks/multiblimp/multiblimp_rus.yaml' 2025-11-27T00:44:21,543 adding 'lm_eval/tasks/multiblimp/multiblimp_sah.yaml' 2025-11-27T00:44:21,544 adding 'lm_eval/tasks/multiblimp/multiblimp_san.yaml' 2025-11-27T00:44:21,545 adding 'lm_eval/tasks/multiblimp/multiblimp_slk.yaml' 2025-11-27T00:44:21,546 adding 'lm_eval/tasks/multiblimp/multiblimp_slv.yaml' 2025-11-27T00:44:21,547 adding 'lm_eval/tasks/multiblimp/multiblimp_sme.yaml' 2025-11-27T00:44:21,548 adding 'lm_eval/tasks/multiblimp/multiblimp_sms.yaml' 2025-11-27T00:44:21,549 adding 'lm_eval/tasks/multiblimp/multiblimp_spa.yaml' 2025-11-27T00:44:21,551 adding 'lm_eval/tasks/multiblimp/multiblimp_sqi.yaml' 2025-11-27T00:44:21,552 adding 'lm_eval/tasks/multiblimp/multiblimp_swe.yaml' 2025-11-27T00:44:21,553 adding 'lm_eval/tasks/multiblimp/multiblimp_tam.yaml' 2025-11-27T00:44:21,554 adding 'lm_eval/tasks/multiblimp/multiblimp_tpn.yaml' 2025-11-27T00:44:21,555 adding 'lm_eval/tasks/multiblimp/multiblimp_ttc.yaml' 2025-11-27T00:44:21,556 adding 'lm_eval/tasks/multiblimp/multiblimp_tur.yaml' 2025-11-27T00:44:21,557 adding 'lm_eval/tasks/multiblimp/multiblimp_uig.yaml' 2025-11-27T00:44:21,559 adding 'lm_eval/tasks/multiblimp/multiblimp_ukr.yaml' 2025-11-27T00:44:21,560 adding 'lm_eval/tasks/multiblimp/multiblimp_urb.yaml' 2025-11-27T00:44:21,561 adding 'lm_eval/tasks/multiblimp/multiblimp_urd.yaml' 2025-11-27T00:44:21,562 adding 'lm_eval/tasks/multiblimp/multiblimp_uzb.yaml' 2025-11-27T00:44:21,563 adding 'lm_eval/tasks/multiblimp/multiblimp_vep.yaml' 2025-11-27T00:44:21,564 adding 'lm_eval/tasks/multiblimp/multiblimp_wbp.yaml' 2025-11-27T00:44:21,566 adding 'lm_eval/tasks/multiblimp/multiblimp_wol.yaml' 2025-11-27T00:44:21,567 adding 'lm_eval/tasks/multiblimp/multiblimp_xcl.yaml' 2025-11-27T00:44:21,568 adding 'lm_eval/tasks/multiblimp/multiblimp_xnr.yaml' 2025-11-27T00:44:21,569 adding 'lm_eval/tasks/multiblimp/multiblimp_xpg.yaml' 2025-11-27T00:44:21,570 adding 'lm_eval/tasks/multiblimp/multiblimp_yrl.yaml' 2025-11-27T00:44:21,572 adding 'lm_eval/tasks/mutual/README.md' 2025-11-27T00:44:21,573 adding 'lm_eval/tasks/mutual/multual_plus.yaml' 2025-11-27T00:44:21,575 adding 'lm_eval/tasks/mutual/mutual.yaml' 2025-11-27T00:44:21,576 adding 'lm_eval/tasks/mutual/utils.py' 2025-11-27T00:44:21,578 adding 'lm_eval/tasks/noreval/README.md' 2025-11-27T00:44:21,660 adding 'lm_eval/tasks/noreval/noreval.jpg' 2025-11-27T00:44:21,666 adding 'lm_eval/tasks/noreval/ask_gec/README.md' 2025-11-27T00:44:21,667 adding 'lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml' 2025-11-27T00:44:21,669 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml' 2025-11-27T00:44:21,670 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml' 2025-11-27T00:44:21,671 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml' 2025-11-27T00:44:21,672 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml' 2025-11-27T00:44:21,673 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml' 2025-11-27T00:44:21,674 adding 'lm_eval/tasks/noreval/ask_gec/errant.py' 2025-11-27T00:44:21,676 adding 'lm_eval/tasks/noreval/ncb/ncb.yaml' 2025-11-27T00:44:21,678 adding 'lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml' 2025-11-27T00:44:21,679 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml' 2025-11-27T00:44:21,680 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml' 2025-11-27T00:44:21,681 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml' 2025-11-27T00:44:21,683 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml' 2025-11-27T00:44:21,684 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml' 2025-11-27T00:44:21,685 adding 'lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml' 2025-11-27T00:44:21,687 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml' 2025-11-27T00:44:21,688 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml' 2025-11-27T00:44:21,689 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml' 2025-11-27T00:44:21,691 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml' 2025-11-27T00:44:21,692 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml' 2025-11-27T00:44:21,693 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml' 2025-11-27T00:44:21,695 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml' 2025-11-27T00:44:21,696 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml' 2025-11-27T00:44:21,697 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml' 2025-11-27T00:44:21,698 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml' 2025-11-27T00:44:21,700 adding 'lm_eval/tasks/noreval/norec/_norec_yaml' 2025-11-27T00:44:21,701 adding 'lm_eval/tasks/noreval/norec/utils.py' 2025-11-27T00:44:21,703 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml' 2025-11-27T00:44:21,704 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml' 2025-11-27T00:44:21,706 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml' 2025-11-27T00:44:21,707 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml' 2025-11-27T00:44:21,708 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml' 2025-11-27T00:44:21,710 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml' 2025-11-27T00:44:21,711 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml' 2025-11-27T00:44:21,712 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml' 2025-11-27T00:44:21,713 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml' 2025-11-27T00:44:21,714 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml' 2025-11-27T00:44:21,716 adding 'lm_eval/tasks/noreval/noridiom/_noridiom_yaml' 2025-11-27T00:44:21,717 adding 'lm_eval/tasks/noreval/noridiom/utils.py' 2025-11-27T00:44:21,719 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml' 2025-11-27T00:44:21,720 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml' 2025-11-27T00:44:21,722 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml' 2025-11-27T00:44:21,723 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml' 2025-11-27T00:44:21,724 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml' 2025-11-27T00:44:21,725 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml' 2025-11-27T00:44:21,727 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml' 2025-11-27T00:44:21,728 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml' 2025-11-27T00:44:21,729 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml' 2025-11-27T00:44:21,730 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml' 2025-11-27T00:44:21,732 adding 'lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml' 2025-11-27T00:44:21,733 adding 'lm_eval/tasks/noreval/noropenbookqa/utils.py' 2025-11-27T00:44:21,735 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml' 2025-11-27T00:44:21,736 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml' 2025-11-27T00:44:21,737 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml' 2025-11-27T00:44:21,739 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml' 2025-11-27T00:44:21,740 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml' 2025-11-27T00:44:21,742 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml' 2025-11-27T00:44:21,743 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml' 2025-11-27T00:44:21,744 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml' 2025-11-27T00:44:21,745 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml' 2025-11-27T00:44:21,746 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml' 2025-11-27T00:44:21,748 adding 'lm_eval/tasks/noreval/norquad/_norquad_yaml' 2025-11-27T00:44:21,749 adding 'lm_eval/tasks/noreval/norquad/norquad_p0.yaml' 2025-11-27T00:44:21,751 adding 'lm_eval/tasks/noreval/norquad/norquad_p1.yaml' 2025-11-27T00:44:21,752 adding 'lm_eval/tasks/noreval/norquad/norquad_p2.yaml' 2025-11-27T00:44:21,753 adding 'lm_eval/tasks/noreval/norquad/norquad_p3.yaml' 2025-11-27T00:44:21,754 adding 'lm_eval/tasks/noreval/norquad/norquad_p4.yaml' 2025-11-27T00:44:21,755 adding 'lm_eval/tasks/noreval/norquad/utils.py' 2025-11-27T00:44:21,757 adding 'lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml' 2025-11-27T00:44:21,759 adding 'lm_eval/tasks/noreval/norsumm/_norsumm_yaml' 2025-11-27T00:44:21,760 adding 'lm_eval/tasks/noreval/norsumm/utils.py' 2025-11-27T00:44:21,762 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml' 2025-11-27T00:44:21,763 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml' 2025-11-27T00:44:21,764 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml' 2025-11-27T00:44:21,765 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml' 2025-11-27T00:44:21,767 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml' 2025-11-27T00:44:21,768 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml' 2025-11-27T00:44:21,770 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml' 2025-11-27T00:44:21,771 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml' 2025-11-27T00:44:21,772 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml' 2025-11-27T00:44:21,773 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml' 2025-11-27T00:44:21,774 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml' 2025-11-27T00:44:21,776 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml' 2025-11-27T00:44:21,777 adding 'lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml' 2025-11-27T00:44:21,780 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml' 2025-11-27T00:44:21,781 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py' 2025-11-27T00:44:21,783 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml' 2025-11-27T00:44:21,784 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml' 2025-11-27T00:44:21,785 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml' 2025-11-27T00:44:21,786 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml' 2025-11-27T00:44:21,788 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml' 2025-11-27T00:44:21,789 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml' 2025-11-27T00:44:21,791 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml' 2025-11-27T00:44:21,792 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml' 2025-11-27T00:44:21,793 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml' 2025-11-27T00:44:21,794 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml' 2025-11-27T00:44:21,796 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml' 2025-11-27T00:44:21,797 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml' 2025-11-27T00:44:21,799 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml' 2025-11-27T00:44:21,800 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml' 2025-11-27T00:44:21,801 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml' 2025-11-27T00:44:21,802 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml' 2025-11-27T00:44:21,803 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py' 2025-11-27T00:44:21,805 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml' 2025-11-27T00:44:21,806 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml' 2025-11-27T00:44:21,808 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml' 2025-11-27T00:44:21,809 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml' 2025-11-27T00:44:21,810 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml' 2025-11-27T00:44:21,811 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py' 2025-11-27T00:44:21,813 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml' 2025-11-27T00:44:21,815 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml' 2025-11-27T00:44:21,816 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml' 2025-11-27T00:44:21,817 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml' 2025-11-27T00:44:21,818 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml' 2025-11-27T00:44:21,820 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml' 2025-11-27T00:44:21,821 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py' 2025-11-27T00:44:21,823 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml' 2025-11-27T00:44:21,824 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml' 2025-11-27T00:44:21,825 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml' 2025-11-27T00:44:21,826 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml' 2025-11-27T00:44:21,827 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml' 2025-11-27T00:44:21,829 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py' 2025-11-27T00:44:21,831 adding 'lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml' 2025-11-27T00:44:21,832 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml' 2025-11-27T00:44:21,834 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml' 2025-11-27T00:44:21,835 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml' 2025-11-27T00:44:21,836 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml' 2025-11-27T00:44:21,837 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml' 2025-11-27T00:44:21,838 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml' 2025-11-27T00:44:21,840 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml' 2025-11-27T00:44:21,841 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml' 2025-11-27T00:44:21,842 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml' 2025-11-27T00:44:21,844 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml' 2025-11-27T00:44:21,845 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml' 2025-11-27T00:44:21,846 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml' 2025-11-27T00:44:21,848 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml' 2025-11-27T00:44:21,849 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml' 2025-11-27T00:44:21,850 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml' 2025-11-27T00:44:21,851 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml' 2025-11-27T00:44:21,853 adding 'lm_eval/tasks/noticia/README.md' 2025-11-27T00:44:21,855 adding 'lm_eval/tasks/noticia/noticia.yaml' 2025-11-27T00:44:21,856 adding 'lm_eval/tasks/noticia/utils.py' 2025-11-27T00:44:21,858 adding 'lm_eval/tasks/nq_open/README.md' 2025-11-27T00:44:21,859 adding 'lm_eval/tasks/nq_open/nq_open.yaml' 2025-11-27T00:44:21,862 adding 'lm_eval/tasks/okapi/arc_multilingual/README.md' 2025-11-27T00:44:21,863 adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml' 2025-11-27T00:44:21,864 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml' 2025-11-27T00:44:21,865 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml' 2025-11-27T00:44:21,866 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml' 2025-11-27T00:44:21,868 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml' 2025-11-27T00:44:21,869 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml' 2025-11-27T00:44:21,870 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml' 2025-11-27T00:44:21,871 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml' 2025-11-27T00:44:21,872 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml' 2025-11-27T00:44:21,873 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml' 2025-11-27T00:44:21,875 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml' 2025-11-27T00:44:21,876 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml' 2025-11-27T00:44:21,877 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml' 2025-11-27T00:44:21,878 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml' 2025-11-27T00:44:21,879 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml' 2025-11-27T00:44:21,881 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml' 2025-11-27T00:44:21,882 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml' 2025-11-27T00:44:21,883 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml' 2025-11-27T00:44:21,884 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml' 2025-11-27T00:44:21,885 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml' 2025-11-27T00:44:21,886 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml' 2025-11-27T00:44:21,888 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml' 2025-11-27T00:44:21,889 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml' 2025-11-27T00:44:21,890 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml' 2025-11-27T00:44:21,891 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml' 2025-11-27T00:44:21,892 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml' 2025-11-27T00:44:21,893 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml' 2025-11-27T00:44:21,895 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml' 2025-11-27T00:44:21,896 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml' 2025-11-27T00:44:21,897 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml' 2025-11-27T00:44:21,898 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml' 2025-11-27T00:44:21,899 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml' 2025-11-27T00:44:21,900 adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py' 2025-11-27T00:44:21,903 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md' 2025-11-27T00:44:21,904 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml' 2025-11-27T00:44:21,905 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml' 2025-11-27T00:44:21,906 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml' 2025-11-27T00:44:21,907 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml' 2025-11-27T00:44:21,909 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml' 2025-11-27T00:44:21,910 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml' 2025-11-27T00:44:21,911 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml' 2025-11-27T00:44:21,912 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml' 2025-11-27T00:44:21,913 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml' 2025-11-27T00:44:21,914 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml' 2025-11-27T00:44:21,915 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml' 2025-11-27T00:44:21,916 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml' 2025-11-27T00:44:21,918 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml' 2025-11-27T00:44:21,919 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml' 2025-11-27T00:44:21,920 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml' 2025-11-27T00:44:21,921 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml' 2025-11-27T00:44:21,922 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml' 2025-11-27T00:44:21,923 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml' 2025-11-27T00:44:21,925 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml' 2025-11-27T00:44:21,926 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml' 2025-11-27T00:44:21,927 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml' 2025-11-27T00:44:21,928 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml' 2025-11-27T00:44:21,929 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml' 2025-11-27T00:44:21,930 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml' 2025-11-27T00:44:21,931 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml' 2025-11-27T00:44:21,933 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml' 2025-11-27T00:44:21,934 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml' 2025-11-27T00:44:21,935 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml' 2025-11-27T00:44:21,936 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml' 2025-11-27T00:44:21,937 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml' 2025-11-27T00:44:21,939 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml' 2025-11-27T00:44:21,940 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py' 2025-11-27T00:44:21,942 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml' 2025-11-27T00:44:21,943 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py' 2025-11-27T00:44:21,944 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml' 2025-11-27T00:44:21,946 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml' 2025-11-27T00:44:21,947 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml' 2025-11-27T00:44:21,948 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml' 2025-11-27T00:44:21,949 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml' 2025-11-27T00:44:21,950 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml' 2025-11-27T00:44:21,951 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml' 2025-11-27T00:44:21,952 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml' 2025-11-27T00:44:21,953 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml' 2025-11-27T00:44:21,954 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml' 2025-11-27T00:44:21,955 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml' 2025-11-27T00:44:21,957 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml' 2025-11-27T00:44:21,958 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml' 2025-11-27T00:44:21,959 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml' 2025-11-27T00:44:21,960 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml' 2025-11-27T00:44:21,961 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml' 2025-11-27T00:44:21,962 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml' 2025-11-27T00:44:21,963 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml' 2025-11-27T00:44:21,965 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml' 2025-11-27T00:44:21,966 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml' 2025-11-27T00:44:21,967 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml' 2025-11-27T00:44:21,968 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml' 2025-11-27T00:44:21,969 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml' 2025-11-27T00:44:21,970 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml' 2025-11-27T00:44:21,972 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml' 2025-11-27T00:44:21,973 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml' 2025-11-27T00:44:21,974 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml' 2025-11-27T00:44:21,975 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml' 2025-11-27T00:44:21,976 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml' 2025-11-27T00:44:21,977 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml' 2025-11-27T00:44:21,978 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml' 2025-11-27T00:44:21,980 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml' 2025-11-27T00:44:21,981 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml' 2025-11-27T00:44:21,982 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml' 2025-11-27T00:44:21,985 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md' 2025-11-27T00:44:21,987 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml' 2025-11-27T00:44:21,988 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml' 2025-11-27T00:44:21,989 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml' 2025-11-27T00:44:21,990 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml' 2025-11-27T00:44:21,991 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml' 2025-11-27T00:44:21,992 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml' 2025-11-27T00:44:21,994 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml' 2025-11-27T00:44:21,995 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml' 2025-11-27T00:44:21,996 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml' 2025-11-27T00:44:21,997 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml' 2025-11-27T00:44:21,999 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml' 2025-11-27T00:44:22,000 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml' 2025-11-27T00:44:22,001 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml' 2025-11-27T00:44:22,002 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml' 2025-11-27T00:44:22,003 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml' 2025-11-27T00:44:22,004 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml' 2025-11-27T00:44:22,005 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml' 2025-11-27T00:44:22,006 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml' 2025-11-27T00:44:22,008 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml' 2025-11-27T00:44:22,009 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml' 2025-11-27T00:44:22,010 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml' 2025-11-27T00:44:22,011 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml' 2025-11-27T00:44:22,012 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml' 2025-11-27T00:44:22,014 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml' 2025-11-27T00:44:22,015 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml' 2025-11-27T00:44:22,016 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml' 2025-11-27T00:44:22,017 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml' 2025-11-27T00:44:22,018 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml' 2025-11-27T00:44:22,019 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml' 2025-11-27T00:44:22,020 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml' 2025-11-27T00:44:22,021 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml' 2025-11-27T00:44:22,023 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml' 2025-11-27T00:44:22,024 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml' 2025-11-27T00:44:22,025 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml' 2025-11-27T00:44:22,026 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml' 2025-11-27T00:44:22,027 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml' 2025-11-27T00:44:22,029 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml' 2025-11-27T00:44:22,030 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml' 2025-11-27T00:44:22,031 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml' 2025-11-27T00:44:22,032 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml' 2025-11-27T00:44:22,033 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml' 2025-11-27T00:44:22,034 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml' 2025-11-27T00:44:22,036 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml' 2025-11-27T00:44:22,037 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml' 2025-11-27T00:44:22,038 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml' 2025-11-27T00:44:22,039 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml' 2025-11-27T00:44:22,040 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml' 2025-11-27T00:44:22,042 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml' 2025-11-27T00:44:22,043 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml' 2025-11-27T00:44:22,044 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml' 2025-11-27T00:44:22,045 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml' 2025-11-27T00:44:22,046 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml' 2025-11-27T00:44:22,047 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml' 2025-11-27T00:44:22,049 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml' 2025-11-27T00:44:22,050 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml' 2025-11-27T00:44:22,051 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml' 2025-11-27T00:44:22,052 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml' 2025-11-27T00:44:22,053 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml' 2025-11-27T00:44:22,054 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml' 2025-11-27T00:44:22,055 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml' 2025-11-27T00:44:22,056 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml' 2025-11-27T00:44:22,058 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml' 2025-11-27T00:44:22,059 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml' 2025-11-27T00:44:22,060 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml' 2025-11-27T00:44:22,062 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py' 2025-11-27T00:44:22,063 adding 'lm_eval/tasks/olaph/README.md' 2025-11-27T00:44:22,065 adding 'lm_eval/tasks/olaph/olaph.yaml' 2025-11-27T00:44:22,066 adding 'lm_eval/tasks/olaph/olaph_perplexity.yaml' 2025-11-27T00:44:22,067 adding 'lm_eval/tasks/olaph/utils.py' 2025-11-27T00:44:22,068 adding 'lm_eval/tasks/olaph/utils_perplexity.py' 2025-11-27T00:44:22,070 adding 'lm_eval/tasks/openbookqa/README.md' 2025-11-27T00:44:22,071 adding 'lm_eval/tasks/openbookqa/openbookqa.yaml' 2025-11-27T00:44:22,073 adding 'lm_eval/tasks/paloma/README.md' 2025-11-27T00:44:22,074 adding 'lm_eval/tasks/paloma/_paloma_template' 2025-11-27T00:44:22,075 adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml' 2025-11-27T00:44:22,077 adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml' 2025-11-27T00:44:22,078 adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml' 2025-11-27T00:44:22,079 adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml' 2025-11-27T00:44:22,080 adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml' 2025-11-27T00:44:22,081 adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml' 2025-11-27T00:44:22,082 adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml' 2025-11-27T00:44:22,084 adding 'lm_eval/tasks/paloma/paloma_gab.yaml' 2025-11-27T00:44:22,085 adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml' 2025-11-27T00:44:22,086 adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml' 2025-11-27T00:44:22,087 adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml' 2025-11-27T00:44:22,088 adding 'lm_eval/tasks/paloma/paloma_mc4.yaml' 2025-11-27T00:44:22,091 adding 'lm_eval/tasks/paloma/paloma_ptb.yaml' 2025-11-27T00:44:22,092 adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml' 2025-11-27T00:44:22,093 adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml' 2025-11-27T00:44:22,094 adding 'lm_eval/tasks/paloma/paloma_utils.py' 2025-11-27T00:44:22,096 adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml' 2025-11-27T00:44:22,098 adding 'lm_eval/tasks/paws-x/README.md' 2025-11-27T00:44:22,099 adding 'lm_eval/tasks/paws-x/_generate_config.py' 2025-11-27T00:44:22,100 adding 'lm_eval/tasks/paws-x/_pawsx.yaml' 2025-11-27T00:44:22,101 adding 'lm_eval/tasks/paws-x/paws_de.yaml' 2025-11-27T00:44:22,102 adding 'lm_eval/tasks/paws-x/paws_en.yaml' 2025-11-27T00:44:22,104 adding 'lm_eval/tasks/paws-x/paws_es.yaml' 2025-11-27T00:44:22,105 adding 'lm_eval/tasks/paws-x/paws_fr.yaml' 2025-11-27T00:44:22,106 adding 'lm_eval/tasks/paws-x/paws_ja.yaml' 2025-11-27T00:44:22,107 adding 'lm_eval/tasks/paws-x/paws_ko.yaml' 2025-11-27T00:44:22,108 adding 'lm_eval/tasks/paws-x/paws_zh.yaml' 2025-11-27T00:44:22,109 adding 'lm_eval/tasks/paws-x/pawsx_template_yaml' 2025-11-27T00:44:22,110 adding 'lm_eval/tasks/paws-x/utils.py' 2025-11-27T00:44:22,112 adding 'lm_eval/tasks/pile/README.md' 2025-11-27T00:44:22,113 adding 'lm_eval/tasks/pile/pile_arxiv.yaml' 2025-11-27T00:44:22,114 adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml' 2025-11-27T00:44:22,115 adding 'lm_eval/tasks/pile/pile_books3.yaml' 2025-11-27T00:44:22,116 adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml' 2025-11-27T00:44:22,117 adding 'lm_eval/tasks/pile/pile_enron.yaml' 2025-11-27T00:44:22,118 adding 'lm_eval/tasks/pile/pile_europarl.yaml' 2025-11-27T00:44:22,120 adding 'lm_eval/tasks/pile/pile_freelaw.yaml' 2025-11-27T00:44:22,121 adding 'lm_eval/tasks/pile/pile_github.yaml' 2025-11-27T00:44:22,122 adding 'lm_eval/tasks/pile/pile_gutenberg.yaml' 2025-11-27T00:44:22,123 adding 'lm_eval/tasks/pile/pile_hackernews.yaml' 2025-11-27T00:44:22,124 adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml' 2025-11-27T00:44:22,125 adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml' 2025-11-27T00:44:22,126 adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml' 2025-11-27T00:44:22,127 adding 'lm_eval/tasks/pile/pile_philpapers.yaml' 2025-11-27T00:44:22,128 adding 'lm_eval/tasks/pile/pile_pile-cc.yaml' 2025-11-27T00:44:22,129 adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml' 2025-11-27T00:44:22,130 adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml' 2025-11-27T00:44:22,132 adding 'lm_eval/tasks/pile/pile_stackexchange.yaml' 2025-11-27T00:44:22,133 adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml' 2025-11-27T00:44:22,134 adding 'lm_eval/tasks/pile/pile_uspto.yaml' 2025-11-27T00:44:22,135 adding 'lm_eval/tasks/pile/pile_wikipedia.yaml' 2025-11-27T00:44:22,136 adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml' 2025-11-27T00:44:22,138 adding 'lm_eval/tasks/pile_10k/README.md' 2025-11-27T00:44:22,139 adding 'lm_eval/tasks/pile_10k/pile_10k.yaml' 2025-11-27T00:44:22,141 adding 'lm_eval/tasks/piqa/README.md' 2025-11-27T00:44:22,142 adding 'lm_eval/tasks/piqa/piqa.yaml' 2025-11-27T00:44:22,144 adding 'lm_eval/tasks/polemo2/README.md' 2025-11-27T00:44:22,145 adding 'lm_eval/tasks/polemo2/polemo2_in.yaml' 2025-11-27T00:44:22,146 adding 'lm_eval/tasks/polemo2/polemo2_out.yaml' 2025-11-27T00:44:22,148 adding 'lm_eval/tasks/portuguese_bench/README.md' 2025-11-27T00:44:22,149 adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml' 2025-11-27T00:44:22,151 adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml' 2025-11-27T00:44:22,152 adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml' 2025-11-27T00:44:22,154 adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml' 2025-11-27T00:44:22,155 adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py' 2025-11-27T00:44:22,157 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml' 2025-11-27T00:44:22,158 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml' 2025-11-27T00:44:22,159 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml' 2025-11-27T00:44:22,160 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml' 2025-11-27T00:44:22,161 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml' 2025-11-27T00:44:22,162 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml' 2025-11-27T00:44:22,164 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml' 2025-11-27T00:44:22,165 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml' 2025-11-27T00:44:22,166 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml' 2025-11-27T00:44:22,167 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml' 2025-11-27T00:44:22,168 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml' 2025-11-27T00:44:22,169 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml' 2025-11-27T00:44:22,171 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml' 2025-11-27T00:44:22,172 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml' 2025-11-27T00:44:22,173 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml' 2025-11-27T00:44:22,174 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml' 2025-11-27T00:44:22,175 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml' 2025-11-27T00:44:22,176 adding 'lm_eval/tasks/prost/README.md' 2025-11-27T00:44:22,177 adding 'lm_eval/tasks/prost/corypaik_prost.yaml' 2025-11-27T00:44:22,179 adding 'lm_eval/tasks/pubmedqa/README.md' 2025-11-27T00:44:22,180 adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py' 2025-11-27T00:44:22,181 adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml' 2025-11-27T00:44:22,183 adding 'lm_eval/tasks/qa4mre/README.md' 2025-11-27T00:44:22,184 adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py' 2025-11-27T00:44:22,185 adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml' 2025-11-27T00:44:22,186 adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml' 2025-11-27T00:44:22,187 adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml' 2025-11-27T00:44:22,189 adding 'lm_eval/tasks/qasper/README.md' 2025-11-27T00:44:22,190 adding 'lm_eval/tasks/qasper/bool.yaml' 2025-11-27T00:44:22,192 adding 'lm_eval/tasks/qasper/freeform.yaml' 2025-11-27T00:44:22,193 adding 'lm_eval/tasks/qasper/metrics.py' 2025-11-27T00:44:22,194 adding 'lm_eval/tasks/qasper/utils.py' 2025-11-27T00:44:22,196 adding 'lm_eval/tasks/race/README.md' 2025-11-27T00:44:22,197 adding 'lm_eval/tasks/race/preprocess_race.py' 2025-11-27T00:44:22,198 adding 'lm_eval/tasks/race/race.yaml' 2025-11-27T00:44:22,200 adding 'lm_eval/tasks/realtoxicityprompts/metric.py' 2025-11-27T00:44:22,202 adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml' 2025-11-27T00:44:22,204 adding 'lm_eval/tasks/ruler/README.md' 2025-11-27T00:44:22,205 adding 'lm_eval/tasks/ruler/common_utils.py' 2025-11-27T00:44:22,206 adding 'lm_eval/tasks/ruler/cwe.yaml' 2025-11-27T00:44:22,208 adding 'lm_eval/tasks/ruler/cwe_utils.py' 2025-11-27T00:44:22,209 adding 'lm_eval/tasks/ruler/essays.py' 2025-11-27T00:44:22,210 adding 'lm_eval/tasks/ruler/fwe.yaml' 2025-11-27T00:44:22,212 adding 'lm_eval/tasks/ruler/fwe_utils.py' 2025-11-27T00:44:22,213 adding 'lm_eval/tasks/ruler/niah_multikey_1.yaml' 2025-11-27T00:44:22,214 adding 'lm_eval/tasks/ruler/niah_multikey_2.yaml' 2025-11-27T00:44:22,215 adding 'lm_eval/tasks/ruler/niah_multikey_3.yaml' 2025-11-27T00:44:22,216 adding 'lm_eval/tasks/ruler/niah_multiquery.yaml' 2025-11-27T00:44:22,217 adding 'lm_eval/tasks/ruler/niah_multivalue.yaml' 2025-11-27T00:44:22,219 adding 'lm_eval/tasks/ruler/niah_single_1.yaml' 2025-11-27T00:44:22,220 adding 'lm_eval/tasks/ruler/niah_single_2.yaml' 2025-11-27T00:44:22,221 adding 'lm_eval/tasks/ruler/niah_single_3.yaml' 2025-11-27T00:44:22,222 adding 'lm_eval/tasks/ruler/niah_utils.py' 2025-11-27T00:44:22,224 adding 'lm_eval/tasks/ruler/prepare_niah.py' 2025-11-27T00:44:22,225 adding 'lm_eval/tasks/ruler/qa_hotpot.yaml' 2025-11-27T00:44:22,226 adding 'lm_eval/tasks/ruler/qa_squad.yaml' 2025-11-27T00:44:22,228 adding 'lm_eval/tasks/ruler/qa_utils.py' 2025-11-27T00:44:22,229 adding 'lm_eval/tasks/ruler/ruler.yaml' 2025-11-27T00:44:22,230 adding 'lm_eval/tasks/ruler/vt.yaml' 2025-11-27T00:44:22,232 adding 'lm_eval/tasks/ruler/vt_utils.py' 2025-11-27T00:44:22,234 adding 'lm_eval/tasks/sciq/README.md' 2025-11-27T00:44:22,235 adding 'lm_eval/tasks/sciq/sciq.yaml' 2025-11-27T00:44:22,237 adding 'lm_eval/tasks/score/NON_GREEDY.md' 2025-11-27T00:44:22,239 adding 'lm_eval/tasks/score/README.md' 2025-11-27T00:44:22,240 adding 'lm_eval/tasks/score/non_greedy.sh' 2025-11-27T00:44:22,242 adding 'lm_eval/tasks/score/non_greedy_summarizer.py' 2025-11-27T00:44:22,243 adding 'lm_eval/tasks/score/score_robustness.yaml' 2025-11-27T00:44:22,245 adding 'lm_eval/tasks/score/utils.py' 2025-11-27T00:44:22,247 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml' 2025-11-27T00:44:22,248 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml' 2025-11-27T00:44:22,249 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml' 2025-11-27T00:44:22,251 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml' 2025-11-27T00:44:22,252 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml' 2025-11-27T00:44:22,253 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml' 2025-11-27T00:44:22,254 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml' 2025-11-27T00:44:22,255 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml' 2025-11-27T00:44:22,256 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml' 2025-11-27T00:44:22,257 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml' 2025-11-27T00:44:22,259 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml' 2025-11-27T00:44:22,260 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml' 2025-11-27T00:44:22,261 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml' 2025-11-27T00:44:22,262 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml' 2025-11-27T00:44:22,263 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml' 2025-11-27T00:44:22,265 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml' 2025-11-27T00:44:22,266 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml' 2025-11-27T00:44:22,267 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml' 2025-11-27T00:44:22,268 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml' 2025-11-27T00:44:22,269 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml' 2025-11-27T00:44:22,271 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml' 2025-11-27T00:44:22,272 adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json' 2025-11-27T00:44:22,273 adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml' 2025-11-27T00:44:22,275 adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml' 2025-11-27T00:44:22,276 adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml' 2025-11-27T00:44:22,277 adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml' 2025-11-27T00:44:22,279 adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py' 2025-11-27T00:44:22,282 adding 'lm_eval/tasks/score/math/math_grader.py' 2025-11-27T00:44:22,284 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml' 2025-11-27T00:44:22,285 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml' 2025-11-27T00:44:22,286 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml' 2025-11-27T00:44:22,287 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml' 2025-11-27T00:44:22,289 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml' 2025-11-27T00:44:22,290 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml' 2025-11-27T00:44:22,291 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml' 2025-11-27T00:44:22,293 adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml' 2025-11-27T00:44:22,294 adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml' 2025-11-27T00:44:22,295 adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml' 2025-11-27T00:44:22,297 adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml' 2025-11-27T00:44:22,298 adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml' 2025-11-27T00:44:22,299 adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml' 2025-11-27T00:44:22,301 adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml' 2025-11-27T00:44:22,302 adding 'lm_eval/tasks/score/math/prompt_templates.json' 2025-11-27T00:44:22,303 adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml' 2025-11-27T00:44:22,305 adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml' 2025-11-27T00:44:22,306 adding 'lm_eval/tasks/score/math/score_robustness_math.yaml' 2025-11-27T00:44:22,307 adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json' 2025-11-27T00:44:22,309 adding 'lm_eval/tasks/score/math/utils_math.py' 2025-11-27T00:44:22,311 adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json' 2025-11-27T00:44:22,312 adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml' 2025-11-27T00:44:22,314 adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml' 2025-11-27T00:44:22,315 adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml' 2025-11-27T00:44:22,316 adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py' 2025-11-27T00:44:22,318 adding 'lm_eval/tasks/scrolls/README.md' 2025-11-27T00:44:22,319 adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml' 2025-11-27T00:44:22,320 adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml' 2025-11-27T00:44:22,322 adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml' 2025-11-27T00:44:22,323 adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml' 2025-11-27T00:44:22,324 adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml' 2025-11-27T00:44:22,325 adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml' 2025-11-27T00:44:22,326 adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml' 2025-11-27T00:44:22,328 adding 'lm_eval/tasks/scrolls/task.py' 2025-11-27T00:44:22,330 adding 'lm_eval/tasks/simple_cooccurrence_bias/README.md' 2025-11-27T00:44:22,331 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml' 2025-11-27T00:44:22,333 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml' 2025-11-27T00:44:22,334 adding 'lm_eval/tasks/simple_cooccurrence_bias/utils.py' 2025-11-27T00:44:22,336 adding 'lm_eval/tasks/siqa/README.md' 2025-11-27T00:44:22,337 adding 'lm_eval/tasks/siqa/siqa.yaml' 2025-11-27T00:44:22,339 adding 'lm_eval/tasks/spanish_bench/README.md' 2025-11-27T00:44:22,341 adding 'lm_eval/tasks/spanish_bench/cocoteros_es.yaml' 2025-11-27T00:44:22,342 adding 'lm_eval/tasks/spanish_bench/copa_es.yaml' 2025-11-27T00:44:22,343 adding 'lm_eval/tasks/spanish_bench/escola.yaml' 2025-11-27T00:44:22,344 adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml' 2025-11-27T00:44:22,345 adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml' 2025-11-27T00:44:22,347 adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml' 2025-11-27T00:44:22,348 adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml' 2025-11-27T00:44:22,349 adding 'lm_eval/tasks/spanish_bench/utils.py' 2025-11-27T00:44:22,351 adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml' 2025-11-27T00:44:22,352 adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml' 2025-11-27T00:44:22,353 adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml' 2025-11-27T00:44:22,355 adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml' 2025-11-27T00:44:22,356 adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py' 2025-11-27T00:44:22,358 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml' 2025-11-27T00:44:22,359 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml' 2025-11-27T00:44:22,360 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml' 2025-11-27T00:44:22,361 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml' 2025-11-27T00:44:22,362 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml' 2025-11-27T00:44:22,364 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml' 2025-11-27T00:44:22,365 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml' 2025-11-27T00:44:22,366 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml' 2025-11-27T00:44:22,367 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml' 2025-11-27T00:44:22,368 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml' 2025-11-27T00:44:22,369 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml' 2025-11-27T00:44:22,370 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml' 2025-11-27T00:44:22,372 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml' 2025-11-27T00:44:22,373 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml' 2025-11-27T00:44:22,374 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml' 2025-11-27T00:44:22,375 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml' 2025-11-27T00:44:22,376 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml' 2025-11-27T00:44:22,378 adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common' 2025-11-27T00:44:22,379 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml' 2025-11-27T00:44:22,380 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml' 2025-11-27T00:44:22,382 adding 'lm_eval/tasks/squad_completion/README.md' 2025-11-27T00:44:22,383 adding 'lm_eval/tasks/squad_completion/squad_completion.yaml' 2025-11-27T00:44:22,384 adding 'lm_eval/tasks/squad_completion/task.py' 2025-11-27T00:44:22,386 adding 'lm_eval/tasks/squadv2/README.md' 2025-11-27T00:44:22,387 adding 'lm_eval/tasks/squadv2/squadv2.yaml' 2025-11-27T00:44:22,389 adding 'lm_eval/tasks/squadv2/task.py' 2025-11-27T00:44:22,391 adding 'lm_eval/tasks/storycloze/README.md' 2025-11-27T00:44:22,392 adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml' 2025-11-27T00:44:22,393 adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml' 2025-11-27T00:44:22,395 adding 'lm_eval/tasks/super_glue/README.md' 2025-11-27T00:44:22,397 adding 'lm_eval/tasks/super_glue/boolq/default.yaml' 2025-11-27T00:44:22,398 adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml' 2025-11-27T00:44:22,399 adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml' 2025-11-27T00:44:22,401 adding 'lm_eval/tasks/super_glue/cb/aggregate.py' 2025-11-27T00:44:22,402 adding 'lm_eval/tasks/super_glue/cb/default.yaml' 2025-11-27T00:44:22,404 adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml' 2025-11-27T00:44:22,405 adding 'lm_eval/tasks/super_glue/cb/t5_utils.py' 2025-11-27T00:44:22,407 adding 'lm_eval/tasks/super_glue/copa/default.yaml' 2025-11-27T00:44:22,408 adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml' 2025-11-27T00:44:22,409 adding 'lm_eval/tasks/super_glue/copa/utils.py' 2025-11-27T00:44:22,411 adding 'lm_eval/tasks/super_glue/multirc/default.yaml' 2025-11-27T00:44:22,412 adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml' 2025-11-27T00:44:22,413 adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py' 2025-11-27T00:44:22,415 adding 'lm_eval/tasks/super_glue/record/default.yaml' 2025-11-27T00:44:22,416 adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml' 2025-11-27T00:44:22,418 adding 'lm_eval/tasks/super_glue/record/t5_utils.py' 2025-11-27T00:44:22,419 adding 'lm_eval/tasks/super_glue/record/util.py' 2025-11-27T00:44:22,421 adding 'lm_eval/tasks/super_glue/rte/default.yaml' 2025-11-27T00:44:22,422 adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml' 2025-11-27T00:44:22,424 adding 'lm_eval/tasks/super_glue/wic/default.yaml' 2025-11-27T00:44:22,425 adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml' 2025-11-27T00:44:22,427 adding 'lm_eval/tasks/super_glue/wsc/default.yaml' 2025-11-27T00:44:22,428 adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py' 2025-11-27T00:44:22,429 adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml' 2025-11-27T00:44:22,431 adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py' 2025-11-27T00:44:22,433 adding 'lm_eval/tasks/swag/README.md' 2025-11-27T00:44:22,434 adding 'lm_eval/tasks/swag/swag.yaml' 2025-11-27T00:44:22,436 adding 'lm_eval/tasks/swde/README.md' 2025-11-27T00:44:22,437 adding 'lm_eval/tasks/swde/swde.yaml' 2025-11-27T00:44:22,439 adding 'lm_eval/tasks/swde/task.py' 2025-11-27T00:44:22,441 adding 'lm_eval/tasks/tinyBenchmarks/README.md' 2025-11-27T00:44:22,442 adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py' 2025-11-27T00:44:22,443 adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml' 2025-11-27T00:44:22,444 adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml' 2025-11-27T00:44:22,445 adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml' 2025-11-27T00:44:22,446 adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml' 2025-11-27T00:44:22,448 adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml' 2025-11-27T00:44:22,449 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml' 2025-11-27T00:44:22,450 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml' 2025-11-27T00:44:22,451 adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml' 2025-11-27T00:44:22,452 adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py' 2025-11-27T00:44:22,454 adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py' 2025-11-27T00:44:22,455 adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py' 2025-11-27T00:44:22,457 adding 'lm_eval/tasks/tmlu/README.md' 2025-11-27T00:44:22,458 adding 'lm_eval/tasks/tmlu/subject.tsv' 2025-11-27T00:44:22,461 adding 'lm_eval/tasks/tmlu/default/_default_template_yaml' 2025-11-27T00:44:22,462 adding 'lm_eval/tasks/tmlu/default/_generate_configs.py' 2025-11-27T00:44:22,463 adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml' 2025-11-27T00:44:22,465 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml' 2025-11-27T00:44:22,466 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml' 2025-11-27T00:44:22,467 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml' 2025-11-27T00:44:22,468 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml' 2025-11-27T00:44:22,470 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml' 2025-11-27T00:44:22,471 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml' 2025-11-27T00:44:22,472 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml' 2025-11-27T00:44:22,473 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml' 2025-11-27T00:44:22,474 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml' 2025-11-27T00:44:22,476 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml' 2025-11-27T00:44:22,477 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml' 2025-11-27T00:44:22,478 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml' 2025-11-27T00:44:22,479 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml' 2025-11-27T00:44:22,480 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml' 2025-11-27T00:44:22,482 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml' 2025-11-27T00:44:22,483 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml' 2025-11-27T00:44:22,484 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml' 2025-11-27T00:44:22,485 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml' 2025-11-27T00:44:22,487 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml' 2025-11-27T00:44:22,488 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml' 2025-11-27T00:44:22,489 adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml' 2025-11-27T00:44:22,490 adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml' 2025-11-27T00:44:22,492 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml' 2025-11-27T00:44:22,493 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml' 2025-11-27T00:44:22,494 adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml' 2025-11-27T00:44:22,495 adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml' 2025-11-27T00:44:22,497 adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml' 2025-11-27T00:44:22,498 adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml' 2025-11-27T00:44:22,499 adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml' 2025-11-27T00:44:22,501 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml' 2025-11-27T00:44:22,502 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml' 2025-11-27T00:44:22,503 adding 'lm_eval/tasks/tmlu/default/utils.py' 2025-11-27T00:44:22,505 adding 'lm_eval/tasks/tmmluplus/README.md' 2025-11-27T00:44:22,506 adding 'lm_eval/tasks/tmmluplus/subject.tsv' 2025-11-27T00:44:22,509 adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py' 2025-11-27T00:44:22,511 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml' 2025-11-27T00:44:22,512 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml' 2025-11-27T00:44:22,513 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml' 2025-11-27T00:44:22,514 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml' 2025-11-27T00:44:22,515 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml' 2025-11-27T00:44:22,516 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml' 2025-11-27T00:44:22,518 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml' 2025-11-27T00:44:22,519 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml' 2025-11-27T00:44:22,520 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml' 2025-11-27T00:44:22,521 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml' 2025-11-27T00:44:22,522 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml' 2025-11-27T00:44:22,524 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml' 2025-11-27T00:44:22,525 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml' 2025-11-27T00:44:22,526 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml' 2025-11-27T00:44:22,527 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml' 2025-11-27T00:44:22,528 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml' 2025-11-27T00:44:22,530 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml' 2025-11-27T00:44:22,531 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml' 2025-11-27T00:44:22,532 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml' 2025-11-27T00:44:22,533 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml' 2025-11-27T00:44:22,534 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml' 2025-11-27T00:44:22,535 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml' 2025-11-27T00:44:22,537 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml' 2025-11-27T00:44:22,538 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml' 2025-11-27T00:44:22,539 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml' 2025-11-27T00:44:22,540 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml' 2025-11-27T00:44:22,541 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml' 2025-11-27T00:44:22,543 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml' 2025-11-27T00:44:22,544 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml' 2025-11-27T00:44:22,545 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml' 2025-11-27T00:44:22,546 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml' 2025-11-27T00:44:22,547 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml' 2025-11-27T00:44:22,549 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml' 2025-11-27T00:44:22,550 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml' 2025-11-27T00:44:22,551 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml' 2025-11-27T00:44:22,553 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml' 2025-11-27T00:44:22,554 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml' 2025-11-27T00:44:22,555 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml' 2025-11-27T00:44:22,556 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml' 2025-11-27T00:44:22,557 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml' 2025-11-27T00:44:22,558 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml' 2025-11-27T00:44:22,560 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml' 2025-11-27T00:44:22,561 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml' 2025-11-27T00:44:22,562 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml' 2025-11-27T00:44:22,564 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml' 2025-11-27T00:44:22,565 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml' 2025-11-27T00:44:22,566 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml' 2025-11-27T00:44:22,567 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml' 2025-11-27T00:44:22,569 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml' 2025-11-27T00:44:22,570 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml' 2025-11-27T00:44:22,571 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml' 2025-11-27T00:44:22,573 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml' 2025-11-27T00:44:22,574 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml' 2025-11-27T00:44:22,575 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml' 2025-11-27T00:44:22,576 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml' 2025-11-27T00:44:22,577 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml' 2025-11-27T00:44:22,578 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml' 2025-11-27T00:44:22,579 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml' 2025-11-27T00:44:22,581 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml' 2025-11-27T00:44:22,582 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml' 2025-11-27T00:44:22,583 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml' 2025-11-27T00:44:22,584 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml' 2025-11-27T00:44:22,585 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml' 2025-11-27T00:44:22,586 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml' 2025-11-27T00:44:22,587 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml' 2025-11-27T00:44:22,589 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml' 2025-11-27T00:44:22,590 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml' 2025-11-27T00:44:22,591 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml' 2025-11-27T00:44:22,592 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml' 2025-11-27T00:44:22,593 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml' 2025-11-27T00:44:22,594 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml' 2025-11-27T00:44:22,595 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml' 2025-11-27T00:44:22,597 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml' 2025-11-27T00:44:22,598 adding 'lm_eval/tasks/tmmluplus/default/utils.py' 2025-11-27T00:44:22,600 adding 'lm_eval/tasks/toxigen/README.md' 2025-11-27T00:44:22,601 adding 'lm_eval/tasks/toxigen/toxigen.yaml' 2025-11-27T00:44:22,602 adding 'lm_eval/tasks/toxigen/utils.py' 2025-11-27T00:44:22,604 adding 'lm_eval/tasks/translation/README.md' 2025-11-27T00:44:22,605 adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml' 2025-11-27T00:44:22,607 adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml' 2025-11-27T00:44:22,608 adding 'lm_eval/tasks/translation/utils.py' 2025-11-27T00:44:22,609 adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml' 2025-11-27T00:44:22,610 adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml' 2025-11-27T00:44:22,611 adding 'lm_eval/tasks/translation/wmt16_de-en.yaml' 2025-11-27T00:44:22,612 adding 'lm_eval/tasks/translation/wmt16_en-de.yaml' 2025-11-27T00:44:22,613 adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml' 2025-11-27T00:44:22,614 adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml' 2025-11-27T00:44:22,615 adding 'lm_eval/tasks/translation/wmt_common_yaml' 2025-11-27T00:44:22,617 adding 'lm_eval/tasks/triviaqa/README.md' 2025-11-27T00:44:22,618 adding 'lm_eval/tasks/triviaqa/default.yaml' 2025-11-27T00:44:22,620 adding 'lm_eval/tasks/truthfulqa/README.md' 2025-11-27T00:44:22,621 adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml' 2025-11-27T00:44:22,623 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml' 2025-11-27T00:44:22,624 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml' 2025-11-27T00:44:22,625 adding 'lm_eval/tasks/truthfulqa/utils.py' 2025-11-27T00:44:22,627 adding 'lm_eval/tasks/truthfulqa-multi/README.md' 2025-11-27T00:44:22,628 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml' 2025-11-27T00:44:22,630 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common' 2025-11-27T00:44:22,631 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml' 2025-11-27T00:44:22,632 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml' 2025-11-27T00:44:22,633 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml' 2025-11-27T00:44:22,634 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml' 2025-11-27T00:44:22,635 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml' 2025-11-27T00:44:22,636 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml' 2025-11-27T00:44:22,637 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml' 2025-11-27T00:44:22,638 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml' 2025-11-27T00:44:22,639 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml' 2025-11-27T00:44:22,641 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml' 2025-11-27T00:44:22,642 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml' 2025-11-27T00:44:22,643 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml' 2025-11-27T00:44:22,644 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml' 2025-11-27T00:44:22,645 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml' 2025-11-27T00:44:22,646 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common' 2025-11-27T00:44:22,648 adding 'lm_eval/tasks/truthfulqa-multi/utils.py' 2025-11-27T00:44:22,650 adding 'lm_eval/tasks/turblimp/README.md' 2025-11-27T00:44:22,651 adding 'lm_eval/tasks/turblimp/_template_yaml' 2025-11-27T00:44:22,652 adding 'lm_eval/tasks/turblimp/anaphor_agreement.yaml' 2025-11-27T00:44:22,654 adding 'lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml' 2025-11-27T00:44:22,655 adding 'lm_eval/tasks/turblimp/argument_structure_transitive.yaml' 2025-11-27T00:44:22,656 adding 'lm_eval/tasks/turblimp/binding.yaml' 2025-11-27T00:44:22,657 adding 'lm_eval/tasks/turblimp/determiners.yaml' 2025-11-27T00:44:22,658 adding 'lm_eval/tasks/turblimp/ellipsis.yaml' 2025-11-27T00:44:22,660 adding 'lm_eval/tasks/turblimp/irregular_forms.yaml' 2025-11-27T00:44:22,661 adding 'lm_eval/tasks/turblimp/island_effects.yaml' 2025-11-27T00:44:22,662 adding 'lm_eval/tasks/turblimp/nominalization.yaml' 2025-11-27T00:44:22,663 adding 'lm_eval/tasks/turblimp/npi_licensing.yaml' 2025-11-27T00:44:22,664 adding 'lm_eval/tasks/turblimp/passives.yaml' 2025-11-27T00:44:22,665 adding 'lm_eval/tasks/turblimp/quantifiers.yaml' 2025-11-27T00:44:22,667 adding 'lm_eval/tasks/turblimp/relative_clauses.yaml' 2025-11-27T00:44:22,668 adding 'lm_eval/tasks/turblimp/scrambling.yaml' 2025-11-27T00:44:22,669 adding 'lm_eval/tasks/turblimp/subject_agreement.yaml' 2025-11-27T00:44:22,670 adding 'lm_eval/tasks/turblimp/suspended_affixation.yaml' 2025-11-27T00:44:22,671 adding 'lm_eval/tasks/turblimp/turblimp_group.yaml' 2025-11-27T00:44:22,673 adding 'lm_eval/tasks/turkishmmlu/README.md' 2025-11-27T00:44:22,675 adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml' 2025-11-27T00:44:22,676 adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml' 2025-11-27T00:44:22,677 adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml' 2025-11-27T00:44:22,678 adding 'lm_eval/tasks/turkishmmlu/config/History.yaml' 2025-11-27T00:44:22,679 adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml' 2025-11-27T00:44:22,680 adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml' 2025-11-27T00:44:22,681 adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml' 2025-11-27T00:44:22,682 adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml' 2025-11-27T00:44:22,684 adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml' 2025-11-27T00:44:22,685 adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml' 2025-11-27T00:44:22,687 adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml' 2025-11-27T00:44:22,689 adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml' 2025-11-27T00:44:22,691 adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml' 2025-11-27T00:44:22,692 adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml' 2025-11-27T00:44:22,694 adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml' 2025-11-27T00:44:22,695 adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml' 2025-11-27T00:44:22,697 adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml' 2025-11-27T00:44:22,699 adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml' 2025-11-27T00:44:22,700 adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml' 2025-11-27T00:44:22,702 adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml' 2025-11-27T00:44:22,704 adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml' 2025-11-27T00:44:22,705 adding 'lm_eval/tasks/unitxt/README.md' 2025-11-27T00:44:22,706 adding 'lm_eval/tasks/unitxt/ag_news.yaml' 2025-11-27T00:44:22,707 adding 'lm_eval/tasks/unitxt/argument_topic.yaml' 2025-11-27T00:44:22,708 adding 'lm_eval/tasks/unitxt/atis.yaml' 2025-11-27T00:44:22,710 adding 'lm_eval/tasks/unitxt/banking77.yaml' 2025-11-27T00:44:22,711 adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml' 2025-11-27T00:44:22,712 adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml' 2025-11-27T00:44:22,713 adding 'lm_eval/tasks/unitxt/coedit_gec.yaml' 2025-11-27T00:44:22,714 adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml' 2025-11-27T00:44:22,715 adding 'lm_eval/tasks/unitxt/doc_vqa.yaml' 2025-11-27T00:44:22,716 adding 'lm_eval/tasks/unitxt/ethos_binary.yaml' 2025-11-27T00:44:22,717 adding 'lm_eval/tasks/unitxt/financial_tweets.yaml' 2025-11-27T00:44:22,719 adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml' 2025-11-27T00:44:22,720 adding 'lm_eval/tasks/unitxt/ledgar.yaml' 2025-11-27T00:44:22,721 adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml' 2025-11-27T00:44:22,722 adding 'lm_eval/tasks/unitxt/stsb.yaml' 2025-11-27T00:44:22,724 adding 'lm_eval/tasks/unitxt/task.py' 2025-11-27T00:44:22,725 adding 'lm_eval/tasks/unitxt/unfair_tos.yaml' 2025-11-27T00:44:22,726 adding 'lm_eval/tasks/unitxt/unitxt' 2025-11-27T00:44:22,727 adding 'lm_eval/tasks/unitxt/unitxt_multimodal' 2025-11-27T00:44:22,728 adding 'lm_eval/tasks/unitxt/xsum.yaml' 2025-11-27T00:44:22,729 adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml' 2025-11-27T00:44:22,732 adding 'lm_eval/tasks/unscramble/README.md' 2025-11-27T00:44:22,733 adding 'lm_eval/tasks/unscramble/anagrams1.yaml' 2025-11-27T00:44:22,734 adding 'lm_eval/tasks/unscramble/anagrams2.yaml' 2025-11-27T00:44:22,735 adding 'lm_eval/tasks/unscramble/cycle_letters.yaml' 2025-11-27T00:44:22,736 adding 'lm_eval/tasks/unscramble/random_insertion.yaml' 2025-11-27T00:44:22,737 adding 'lm_eval/tasks/unscramble/reversed_words.yaml' 2025-11-27T00:44:22,739 adding 'lm_eval/tasks/webqs/README.md' 2025-11-27T00:44:22,740 adding 'lm_eval/tasks/webqs/utils.py' 2025-11-27T00:44:22,741 adding 'lm_eval/tasks/webqs/webqs.yaml' 2025-11-27T00:44:22,743 adding 'lm_eval/tasks/wikitext/README.md' 2025-11-27T00:44:22,744 adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py' 2025-11-27T00:44:22,745 adding 'lm_eval/tasks/wikitext/wikitext.yaml' 2025-11-27T00:44:22,747 adding 'lm_eval/tasks/winogender/README.md' 2025-11-27T00:44:22,749 adding 'lm_eval/tasks/winogender/utils.py' 2025-11-27T00:44:22,750 adding 'lm_eval/tasks/winogender/winogender.yaml' 2025-11-27T00:44:22,751 adding 'lm_eval/tasks/winogender/winogender_female.yaml' 2025-11-27T00:44:22,752 adding 'lm_eval/tasks/winogender/winogender_gotcha.yaml' 2025-11-27T00:44:22,753 adding 'lm_eval/tasks/winogender/winogender_gotcha_female.yaml' 2025-11-27T00:44:22,754 adding 'lm_eval/tasks/winogender/winogender_gotcha_male.yaml' 2025-11-27T00:44:22,755 adding 'lm_eval/tasks/winogender/winogender_male.yaml' 2025-11-27T00:44:22,756 adding 'lm_eval/tasks/winogender/winogender_neutral.yaml' 2025-11-27T00:44:22,758 adding 'lm_eval/tasks/winogrande/README.md' 2025-11-27T00:44:22,759 adding 'lm_eval/tasks/winogrande/default.yaml' 2025-11-27T00:44:22,760 adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py' 2025-11-27T00:44:22,762 adding 'lm_eval/tasks/wmdp/README.md' 2025-11-27T00:44:22,763 adding 'lm_eval/tasks/wmdp/_default_template_yaml' 2025-11-27T00:44:22,765 adding 'lm_eval/tasks/wmdp/_wmdp.yaml' 2025-11-27T00:44:22,766 adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml' 2025-11-27T00:44:22,767 adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml' 2025-11-27T00:44:22,768 adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml' 2025-11-27T00:44:22,770 adding 'lm_eval/tasks/wmt2016/README.md' 2025-11-27T00:44:22,771 adding 'lm_eval/tasks/wmt2016/metrics.py' 2025-11-27T00:44:22,772 adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml' 2025-11-27T00:44:22,774 adding 'lm_eval/tasks/wsc273/README.md' 2025-11-27T00:44:22,776 adding 'lm_eval/tasks/wsc273/default.yaml' 2025-11-27T00:44:22,777 adding 'lm_eval/tasks/wsc273/utils.py' 2025-11-27T00:44:22,779 adding 'lm_eval/tasks/xcopa/README.md' 2025-11-27T00:44:22,780 adding 'lm_eval/tasks/xcopa/_xcopa.yaml' 2025-11-27T00:44:22,781 adding 'lm_eval/tasks/xcopa/default_et.yaml' 2025-11-27T00:44:22,782 adding 'lm_eval/tasks/xcopa/default_ht.yaml' 2025-11-27T00:44:22,783 adding 'lm_eval/tasks/xcopa/default_id.yaml' 2025-11-27T00:44:22,785 adding 'lm_eval/tasks/xcopa/default_it.yaml' 2025-11-27T00:44:22,786 adding 'lm_eval/tasks/xcopa/default_qu.yaml' 2025-11-27T00:44:22,787 adding 'lm_eval/tasks/xcopa/default_sw.yaml' 2025-11-27T00:44:22,788 adding 'lm_eval/tasks/xcopa/default_ta.yaml' 2025-11-27T00:44:22,789 adding 'lm_eval/tasks/xcopa/default_th.yaml' 2025-11-27T00:44:22,790 adding 'lm_eval/tasks/xcopa/default_tr.yaml' 2025-11-27T00:44:22,791 adding 'lm_eval/tasks/xcopa/default_vi.yaml' 2025-11-27T00:44:22,793 adding 'lm_eval/tasks/xcopa/default_zh.yaml' 2025-11-27T00:44:22,794 adding 'lm_eval/tasks/xcopa/utils.py' 2025-11-27T00:44:22,796 adding 'lm_eval/tasks/xnli/README.md' 2025-11-27T00:44:22,797 adding 'lm_eval/tasks/xnli/_xnli.yaml' 2025-11-27T00:44:22,799 adding 'lm_eval/tasks/xnli/utils.py' 2025-11-27T00:44:22,800 adding 'lm_eval/tasks/xnli/xnli_ar.yaml' 2025-11-27T00:44:22,801 adding 'lm_eval/tasks/xnli/xnli_bg.yaml' 2025-11-27T00:44:22,802 adding 'lm_eval/tasks/xnli/xnli_common_yaml' 2025-11-27T00:44:22,803 adding 'lm_eval/tasks/xnli/xnli_de.yaml' 2025-11-27T00:44:22,805 adding 'lm_eval/tasks/xnli/xnli_el.yaml' 2025-11-27T00:44:22,806 adding 'lm_eval/tasks/xnli/xnli_en.yaml' 2025-11-27T00:44:22,807 adding 'lm_eval/tasks/xnli/xnli_es.yaml' 2025-11-27T00:44:22,808 adding 'lm_eval/tasks/xnli/xnli_fr.yaml' 2025-11-27T00:44:22,809 adding 'lm_eval/tasks/xnli/xnli_hi.yaml' 2025-11-27T00:44:22,810 adding 'lm_eval/tasks/xnli/xnli_ru.yaml' 2025-11-27T00:44:22,811 adding 'lm_eval/tasks/xnli/xnli_sw.yaml' 2025-11-27T00:44:22,813 adding 'lm_eval/tasks/xnli/xnli_th.yaml' 2025-11-27T00:44:22,814 adding 'lm_eval/tasks/xnli/xnli_tr.yaml' 2025-11-27T00:44:22,815 adding 'lm_eval/tasks/xnli/xnli_ur.yaml' 2025-11-27T00:44:22,816 adding 'lm_eval/tasks/xnli/xnli_vi.yaml' 2025-11-27T00:44:22,817 adding 'lm_eval/tasks/xnli/xnli_zh.yaml' 2025-11-27T00:44:22,819 adding 'lm_eval/tasks/xnli_eu/README.md' 2025-11-27T00:44:22,820 adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml' 2025-11-27T00:44:22,821 adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml' 2025-11-27T00:44:22,822 adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml' 2025-11-27T00:44:22,823 adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml' 2025-11-27T00:44:22,825 adding 'lm_eval/tasks/xquad/README.md' 2025-11-27T00:44:22,827 adding 'lm_eval/tasks/xquad/utils.py' 2025-11-27T00:44:22,828 adding 'lm_eval/tasks/xquad/xquad_ar.yaml' 2025-11-27T00:44:22,829 adding 'lm_eval/tasks/xquad/xquad_common_yaml' 2025-11-27T00:44:22,830 adding 'lm_eval/tasks/xquad/xquad_de.yaml' 2025-11-27T00:44:22,831 adding 'lm_eval/tasks/xquad/xquad_el.yaml' 2025-11-27T00:44:22,832 adding 'lm_eval/tasks/xquad/xquad_en.yaml' 2025-11-27T00:44:22,833 adding 'lm_eval/tasks/xquad/xquad_es.yaml' 2025-11-27T00:44:22,834 adding 'lm_eval/tasks/xquad/xquad_hi.yaml' 2025-11-27T00:44:22,836 adding 'lm_eval/tasks/xquad/xquad_ro.yaml' 2025-11-27T00:44:22,837 adding 'lm_eval/tasks/xquad/xquad_ru.yaml' 2025-11-27T00:44:22,838 adding 'lm_eval/tasks/xquad/xquad_th.yaml' 2025-11-27T00:44:22,839 adding 'lm_eval/tasks/xquad/xquad_tr.yaml' 2025-11-27T00:44:22,840 adding 'lm_eval/tasks/xquad/xquad_vi.yaml' 2025-11-27T00:44:22,841 adding 'lm_eval/tasks/xquad/xquad_zh.yaml' 2025-11-27T00:44:22,843 adding 'lm_eval/tasks/xstorycloze/README.md' 2025-11-27T00:44:22,844 adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml' 2025-11-27T00:44:22,846 adding 'lm_eval/tasks/xstorycloze/default_ar.yaml' 2025-11-27T00:44:22,847 adding 'lm_eval/tasks/xstorycloze/default_en.yaml' 2025-11-27T00:44:22,848 adding 'lm_eval/tasks/xstorycloze/default_es.yaml' 2025-11-27T00:44:22,849 adding 'lm_eval/tasks/xstorycloze/default_eu.yaml' 2025-11-27T00:44:22,850 adding 'lm_eval/tasks/xstorycloze/default_hi.yaml' 2025-11-27T00:44:22,851 adding 'lm_eval/tasks/xstorycloze/default_id.yaml' 2025-11-27T00:44:22,852 adding 'lm_eval/tasks/xstorycloze/default_my.yaml' 2025-11-27T00:44:22,853 adding 'lm_eval/tasks/xstorycloze/default_ru.yaml' 2025-11-27T00:44:22,855 adding 'lm_eval/tasks/xstorycloze/default_sw.yaml' 2025-11-27T00:44:22,856 adding 'lm_eval/tasks/xstorycloze/default_te.yaml' 2025-11-27T00:44:22,857 adding 'lm_eval/tasks/xstorycloze/default_zh.yaml' 2025-11-27T00:44:22,859 adding 'lm_eval/tasks/xwinograd/README.md' 2025-11-27T00:44:22,860 adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml' 2025-11-27T00:44:22,862 adding 'lm_eval/tasks/xwinograd/utils.py' 2025-11-27T00:44:22,863 adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml' 2025-11-27T00:44:22,864 adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml' 2025-11-27T00:44:22,865 adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml' 2025-11-27T00:44:22,866 adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml' 2025-11-27T00:44:22,867 adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml' 2025-11-27T00:44:22,868 adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml' 2025-11-27T00:44:22,870 adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml' 2025-11-27T00:44:22,873 adding 'lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml' 2025-11-27T00:44:22,874 adding 'lm_eval/tasks/zhoblimp/BA_deletion.yaml' 2025-11-27T00:44:22,876 adding 'lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml' 2025-11-27T00:44:22,877 adding 'lm_eval/tasks/zhoblimp/BA_inversion.yaml' 2025-11-27T00:44:22,878 adding 'lm_eval/tasks/zhoblimp/BA_meiba.yaml' 2025-11-27T00:44:22,879 adding 'lm_eval/tasks/zhoblimp/BA_negation.yaml' 2025-11-27T00:44:22,880 adding 'lm_eval/tasks/zhoblimp/BA_no_progressive.yaml' 2025-11-27T00:44:22,881 adding 'lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml' 2025-11-27T00:44:22,882 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml' 2025-11-27T00:44:22,883 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml' 2025-11-27T00:44:22,884 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml' 2025-11-27T00:44:22,885 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml' 2025-11-27T00:44:22,886 adding 'lm_eval/tasks/zhoblimp/BEI_construction_a.yaml' 2025-11-27T00:44:22,887 adding 'lm_eval/tasks/zhoblimp/BEI_construction_b.yaml' 2025-11-27T00:44:22,888 adding 'lm_eval/tasks/zhoblimp/BEI_deletion.yaml' 2025-11-27T00:44:22,889 adding 'lm_eval/tasks/zhoblimp/BEI_preposition.yaml' 2025-11-27T00:44:22,890 adding 'lm_eval/tasks/zhoblimp/PN_numP_a.yaml' 2025-11-27T00:44:22,891 adding 'lm_eval/tasks/zhoblimp/PN_numP_b.yaml' 2025-11-27T00:44:22,892 adding 'lm_eval/tasks/zhoblimp/README.md' 2025-11-27T00:44:22,894 adding 'lm_eval/tasks/zhoblimp/_template_yaml' 2025-11-27T00:44:22,895 adding 'lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml' 2025-11-27T00:44:22,896 adding 'lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml' 2025-11-27T00:44:22,897 adding 'lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml' 2025-11-27T00:44:22,898 adding 'lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml' 2025-11-27T00:44:22,899 adding 'lm_eval/tasks/zhoblimp/agent_causative.yaml' 2025-11-27T00:44:22,900 adding 'lm_eval/tasks/zhoblimp/agent_deletion.yaml' 2025-11-27T00:44:22,901 adding 'lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml' 2025-11-27T00:44:22,902 adding 'lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml' 2025-11-27T00:44:22,904 adding 'lm_eval/tasks/zhoblimp/causative_shi_ba.yaml' 2025-11-27T00:44:22,905 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml' 2025-11-27T00:44:22,906 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml' 2025-11-27T00:44:22,907 adding 'lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml' 2025-11-27T00:44:22,908 adding 'lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml' 2025-11-27T00:44:22,909 adding 'lm_eval/tasks/zhoblimp/ellipsis_adj.yaml' 2025-11-27T00:44:22,910 adding 'lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml' 2025-11-27T00:44:22,911 adding 'lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml' 2025-11-27T00:44:22,913 adding 'lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml' 2025-11-27T00:44:22,914 adding 'lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml' 2025-11-27T00:44:22,915 adding 'lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml' 2025-11-27T00:44:22,916 adding 'lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml' 2025-11-27T00:44:22,917 adding 'lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml' 2025-11-27T00:44:22,918 adding 'lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml' 2025-11-27T00:44:22,919 adding 'lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml' 2025-11-27T00:44:22,921 adding 'lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml' 2025-11-27T00:44:22,922 adding 'lm_eval/tasks/zhoblimp/left_adverbial_b.yaml' 2025-11-27T00:44:22,923 adding 'lm_eval/tasks/zhoblimp/left_adverbial_d.yaml' 2025-11-27T00:44:22,924 adding 'lm_eval/tasks/zhoblimp/left_adverbial_e.yaml' 2025-11-27T00:44:22,925 adding 'lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml' 2025-11-27T00:44:22,926 adding 'lm_eval/tasks/zhoblimp/left_dou.yaml' 2025-11-27T00:44:22,927 adding 'lm_eval/tasks/zhoblimp/modal_raising_hui.yaml' 2025-11-27T00:44:22,928 adding 'lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml' 2025-11-27T00:44:22,929 adding 'lm_eval/tasks/zhoblimp/nominal_definite_men.yaml' 2025-11-27T00:44:22,931 adding 'lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml' 2025-11-27T00:44:22,932 adding 'lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml' 2025-11-27T00:44:22,933 adding 'lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml' 2025-11-27T00:44:22,934 adding 'lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml' 2025-11-27T00:44:22,935 adding 'lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml' 2025-11-27T00:44:22,936 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml' 2025-11-27T00:44:22,937 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml' 2025-11-27T00:44:22,938 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml' 2025-11-27T00:44:22,939 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml' 2025-11-27T00:44:22,940 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml' 2025-11-27T00:44:22,941 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml' 2025-11-27T00:44:22,942 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml' 2025-11-27T00:44:22,943 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml' 2025-11-27T00:44:22,944 adding 'lm_eval/tasks/zhoblimp/passive_body_part.yaml' 2025-11-27T00:44:22,945 adding 'lm_eval/tasks/zhoblimp/passive_intransitive.yaml' 2025-11-27T00:44:22,946 adding 'lm_eval/tasks/zhoblimp/passive_no_adj.yaml' 2025-11-27T00:44:22,948 adding 'lm_eval/tasks/zhoblimp/passive_suo.yaml' 2025-11-27T00:44:22,949 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml' 2025-11-27T00:44:22,950 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml' 2025-11-27T00:44:22,951 adding 'lm_eval/tasks/zhoblimp/preposition_deletion.yaml' 2025-11-27T00:44:22,952 adding 'lm_eval/tasks/zhoblimp/preposition_insertion.yaml' 2025-11-27T00:44:22,953 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command.yaml' 2025-11-27T00:44:22,954 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml' 2025-11-27T00:44:22,955 adding 'lm_eval/tasks/zhoblimp/principle_A_domain.yaml' 2025-11-27T00:44:22,956 adding 'lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml' 2025-11-27T00:44:22,957 adding 'lm_eval/tasks/zhoblimp/question_A_not_A.yaml' 2025-11-27T00:44:22,958 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml' 2025-11-27T00:44:22,960 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml' 2025-11-27T00:44:22,961 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml' 2025-11-27T00:44:22,962 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml' 2025-11-27T00:44:22,963 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml' 2025-11-27T00:44:22,964 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml' 2025-11-27T00:44:22,965 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml' 2025-11-27T00:44:22,966 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml' 2025-11-27T00:44:22,967 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml' 2025-11-27T00:44:22,969 adding 'lm_eval/tasks/zhoblimp/question_daodi_negation.yaml' 2025-11-27T00:44:22,970 adding 'lm_eval/tasks/zhoblimp/question_nandao_negation.yaml' 2025-11-27T00:44:22,971 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml' 2025-11-27T00:44:22,972 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml' 2025-11-27T00:44:22,973 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml' 2025-11-27T00:44:22,974 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml' 2025-11-27T00:44:22,975 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml' 2025-11-27T00:44:22,977 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml' 2025-11-27T00:44:22,978 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml' 2025-11-27T00:44:22,979 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml' 2025-11-27T00:44:22,980 adding 'lm_eval/tasks/zhoblimp/question_particle_nandao.yaml' 2025-11-27T00:44:22,981 adding 'lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml' 2025-11-27T00:44:22,982 adding 'lm_eval/tasks/zhoblimp/relative_operator_who.yaml' 2025-11-27T00:44:22,983 adding 'lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml' 2025-11-27T00:44:22,985 adding 'lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml' 2025-11-27T00:44:22,986 adding 'lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml' 2025-11-27T00:44:22,987 adding 'lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml' 2025-11-27T00:44:22,988 adding 'lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml' 2025-11-27T00:44:22,989 adding 'lm_eval/tasks/zhoblimp/right_yijing_a.yaml' 2025-11-27T00:44:22,990 adding 'lm_eval/tasks/zhoblimp/right_yijing_b.yaml' 2025-11-27T00:44:22,991 adding 'lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml' 2025-11-27T00:44:22,992 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml' 2025-11-27T00:44:22,993 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml' 2025-11-27T00:44:22,994 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV.yaml' 2025-11-27T00:44:22,995 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml' 2025-11-27T00:44:22,996 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV.yaml' 2025-11-27T00:44:22,997 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml' 2025-11-27T00:44:22,999 adding 'lm_eval/tasks/zhoblimp/verb_negation_particle.yaml' 2025-11-27T00:44:23,000 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml' 2025-11-27T00:44:23,001 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml' 2025-11-27T00:44:23,002 adding 'lm_eval/tasks/zhoblimp/ya_insertion.yaml' 2025-11-27T00:44:23,003 adding 'lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml' 2025-11-27T00:44:23,004 adding 'lm_eval/tasks/zhoblimp/you_yige.yaml' 2025-11-27T00:44:23,005 adding 'lm_eval/tasks/zhoblimp/zhoblimp_group.yaml' 2025-11-27T00:44:23,008 adding 'lm_eval-0.4.9.2.dist-info/licenses/LICENSE.md' 2025-11-27T00:44:23,014 adding 'lm_eval-0.4.9.2.dist-info/METADATA' 2025-11-27T00:44:23,015 adding 'lm_eval-0.4.9.2.dist-info/WHEEL' 2025-11-27T00:44:23,016 adding 'lm_eval-0.4.9.2.dist-info/entry_points.txt' 2025-11-27T00:44:23,017 adding 'lm_eval-0.4.9.2.dist-info/top_level.txt' 2025-11-27T00:44:23,259 adding 'lm_eval-0.4.9.2.dist-info/RECORD' 2025-11-27T00:44:23,497 removing build/bdist.linux-armv7l/wheel 2025-11-27T00:44:26,860 Building wheel for lm-eval (pyproject.toml): finished with status 'done' 2025-11-27T00:44:27,065 Created wheel for lm-eval: filename=lm_eval-0.4.9.2-py3-none-any.whl size=8231261 sha256=6433acae848f5040a05aec1f8b4d946c1874207195592064a0dccbf11e6a3bf7 2025-11-27T00:44:27,066 Stored in directory: /tmp/pip-ephem-wheel-cache-z8vd2ope/wheels/e3/9c/dd/745568324e0a6e310596ad469a511dc40ab39dfa08f6a5b4fd 2025-11-27T00:44:27,502 Successfully built lm-eval 2025-11-27T00:44:27,679 Removed build tracker: '/tmp/pip-build-tracker-i0t12tb4'